Authors: Michael K. Slade and Russell T. Warne
Institution: Utah Valley University
Because of their widespread use, trauma-focused cognitive-behavioral therapy (TF-CBT) and play therapy (PT) were selected as treatments to be included in a meta-analytic study examining their effectiveness in aiding victims of child abuse. Studies analyzing the effectiveness of TF-CBT or PT were found using Academic Search Premier, PsycARTICLES, Psychological and Behavioral Sciences Collection, PsychINFO, Google Scholar, and Digital Dissertation. Ten studies (N = 762) were combined into two separate meta-analyses, one for TF-CBT and one for PT. These were coded, and four general outcome categories were identified: externalizing, internalizing, sexual, and parent report. Results showed an overall effect size of d = .212 for TF-CBT and d = .095 for PT. TF-CBT was more effective than PT on all outcome measures, except for externalizing behavior (PT d =.255 and TF-CBT d =.187). These results indicate that both TF-CBT and PT can be beneficial for victims of child abuse, though TF-CBT usually has more positive outcomes. Future studies should use a wait-list control group and random assignment.
Child maltreatment is a serious societal problem. In spite of this fact, researchers and practitioners do not agree on a single definition for child maltreatment, or even what the various forms of child maltreatment consist of (Barnett, Perrin, & Perrin, 2011; Dubowitz, Papas, Black, & Starr, 2002). Typically, the phrase “child maltreatment” is used to group the various forms of child abuse and neglect into one convenient term, with the most common forms of child abuse labels being physical, emotional/psychological, neglect, and sexual abuse. Each year millions of children are victims of this societal problem (Barnett et al., 2011; Trickett, Negriff, Ji, & Peckins, 2011).
While there are no agreed on definitions for each of the types of maltreatment there are common themes that categorize each. Child physical abuse (CPA) typically involves two standards: (a) the harm standard and (b) the endangerment standard. The harm standard recognizes that the child is a victim of CPA if the child has observable injuries for at least 48 hours (Barnett et al., 2011). The endangerment standard requires victims to be deemed at a substantial risk for injury or endangerment (Barnett et al., 2011). Emotional or psychological abuse is damaging the child by verbally or emotionally tearing the child down and objectifying the child. This can take many forms such as spurning, isolating, exploiting, rejecting, denying affection, and corrupting the child (Barnett et al., 2011).
Sexual abuse is very common in America, with one in four females and one in seven males being victims of sexual abuse prior to turning 18 (Misurell, Springer, & Tryon, 2011). Child sexual abuse (CSA) may involve fondling, masturbating, penetrating, vaginal/anal intercourse, taking nude pictures of the child, or even giving pornographic materials to a minor. While we will use this as the definition for CSA, it should be noted that there is no universal definition among experts (Barnett et al., 2011).
Child neglect is the most commonly reported form of child maltreatment (Barnett et al., 2011; Dubowitz, et al., 2002). Neglect varies from the other forms of maltreatment because rather than committing an act against a child (as in abuse), an important need of the child is not being met. Dubowitz et al. (2002) identified three fundamental needs which must be met for children: (a) perceived support from mothers, (b) lack of exposure to family conflict, and (c) early affection from mothers. Treatment for child maltreatment is vital because of the many long-term negative effects for many of the victims (e.g., suicidal ideation, sexual acting out, attachment issues, aggression, and many others; Easton, Coohey, O’leary, Zhang, & Hua, 2011; Hetzel-Riggin, Brausch, & Montgomery, 2007; Nolan et al., 2002; Saywitz, Mannarino, Berliner, & Cohen, 2000; Scott, Burlingame, Starling, Porter, & Lilly, 2003).
Types of Therapy
Millions of children each year are victims of these various forms of child maltreatment. As a result, there have been many forms of treatment developed to help victims of child maltreatment overcome or cope with the negative outcomes of that maltreatment. The two most commonly used types of therapies are play therapy (PT) and cognitive behavioral therapy (CBT; Kaduson, 2011; Misurell et al., 2011; Scott et al., 2003).
Play therapy involves mastering traumatic events, a process known as abreaction. Abreaction requires a reliving and mastering of the traumatic event, resulting in catharsis, defined as a release of affect that brings about relief (Nash & Schaefer, 2011).
Mechanics of play therapy
PT tends to be a long therapy, lasting around 30 sessions (Scott et al., 2003). The usual age for a client is three to 12 years, but using PT to help adolescents and adults has been gaining traction in recent years (Nash & Schaefer, 2011). Therapists can practice PT in almost any setting. According to Nash and Schaefer (2011), the two most important aspects of a play space are predictability and consistency. This enables the children to focus on playing instead of exploring a new setting.
There are three main stages in PT: (a) rapport building, (b) working through, and (c) termination. Rapport building takes place during the first sessions. These sessions focus on building an appropriate therapist-client relationship by learning about the child, learning about his or her experiences, having the child learn about the playroom, and, depending on the therapist’s theoretical orientation, teaching the child about the therapy (Nash & Schaefer, 2011). The next phase, working through, is the longest. This is the phase in which most of the therapeutic change occurs. In this phase, play themes become apparent and gives clues about the child’s inner world. How these themes are utilized in therapy will depend on the theoretical orientation of the therapist; for example, a Jungian therapist will relate the themes to archetypes and a Freudian therapist will relate them to cathected libidinal energies. The final stage, termination, is for the child and family to recognize the changes, make the changes endemic to their family culture, and organize a path for continued improvements (Nash & Schaefer, 2011).
Types of play therapy
PT can be divided into four broad categories based on the theoretical orientation of the therapist: psychodynamic, humanistic, systemic, and emerging models (Gil, 2011; Green, 2011; Kottman, 2011; Levy, 2011; Munns, 2011; Sweeney & Landreth, 2011). Each of these broad categories has many specific manifestations and practices. The different theoretical orientations may impact how therapy is conducted, what therapeutic tools are used, and how the therapist relates to the client (Gil, 2011; Ginsberg, 2011; Green, 2011; Kottman, 2011; Levy, 2011; Munns, 2011; Norton & Norton, 2011; Oaklander, 2011; O’Connor, 2011; Sweeney, 2011; Sweeney & Landreth, 2011; VanFleet, 2011).
It should be noted that many parents are trained to incorporate PT at home. Parents who have received the training to perform PT sessions in their own home have reported an increase in empathy and acceptance toward their children, as well as a reduction in parental stress levels (Nash & Schaefer, 2011). It has been noted that when parents use PT at home, children’s behavior, emotional adjustment and self-concept improves, while anxiety levels decrease (Nolan et al., 2002, Scott et al., 2003).
Cognitive-Behavioral Therapy (CBT) is the other most common form of psychotherapy used today, and is supported by a wealth of empirical evidence (Arnkoff & Glass, 1992; Grasso, Marquez, Joselow, & Webb, 2011; Saywitz et al., 2000). Because of the widespread use of CBT, many sub-forms of therapy have developed. Trauma-focused CBT (TF-CBT), which we examine in this meta-analysis, is one of the preferred methods of therapy for victims of trauma (Grasso et al., 2011).
CBT typically requires 12-16 sessions divided into three phases. In the first phase, the child and parent undergo gradual exposure to traumatic content, and the discussion becomes increasingly focused on the child’s personal experience in reaction to the stimulus. In the second phase the child begins to develop a detailed account of the traumatic event, called a “trauma narrative,” that functions as a means of therapeutic exposure and helps to facilitate emotional and cognitive processing. The parent meets with the therapist separately until the trauma narrative is complete. If the child is comfortable and the parent ready, the therapist encourages the child to share the narrative with the parent in a conjoined session. In the third phase, treatment focuses on safety skills and future development (Grasso et al., 2011). These sessions are designed to reduce behavioral and emotional problems from child trauma exposure. The sessions should also empower children and parents with a knowledge-base essential for therapy. Another goal of the sessions is to provide a skillset that includes education about trauma, posttraumatic stress, treatment rationale, relaxation techniques, emotion identification, regulation skills, and cognitive coping strategies.
History of CBT
CBT is a blending of cognitive and behavior therapy techniques that was fully developed by the 1950’s with the work on cognitive theory by Albert Ellis and the cognitive revolution, though its roots originated much further back than the behavior modification work of Pavlov, investigated by Watson and Skinner. Built on techniques for behavior therapy that have been around for most of recorded history (e.g., putting a spider in alcohol to prevent alcoholics from drinking, giving candy to reward positive behaviors, or spanking when a child hits someone; Glass & Arnkoff, 1992), CBT is a blending of behavioral and cognitive therapies that are used to treat a wide variety of psychopathologies.
Trauma-focused CBT (TF-CBT) is one of the most preferred subtypes of CBT for helping victims of trauma; Yet, many feel that the trauma narrative is very helpful for victims of all forms of abuse (Classen et al., 2011; Misurell et al., 2011). TF-CBT adds a trauma narrative to the therapeutic repertoire of CBT. This narrative is to help the victim be able to process the trauma and work through the emotions that arise. Additionally, TF-CBT focuses on the trauma and gears all education to the trauma and to similar traumas (Feather & Ronan, 2006).
To find articles for the meta-analysis, we searched Academic Search Premier, PsycARTICLES, Psychological and Behavioral Sciences Collection, PsychINFO, Google Scholar, and Digital Dissertation for “child,” “abuse,” “treatment,” “outcomes,” “play therapy,” “trauma focused,” “cognitive behavior therapy,” “CBT,” “PT,” in various aggregates and using various truncators (e.g., AND, OR, *). Articles that were included in the meta-analysis needed to (a) be published after 1980, (b) have a maximum age of 18 for participants undergoing therapy, (c) contain participants who were victims of physical or sexual abuse, (d) be a quantitative article that either reported effect sizes or instead contain enough data for effect sizes to be calculated, and (e) contain a report with treatment that was either PT or TF-CBT. All articles that met the inclusion criteria were used in the data analysis. We found 31 effect sizes in ten peer-reviewed articles and two doctoral dissertations that met the inclusion criteria; however, we noticed that the doctoral dissertations had samples that were identical to some of the peer-reviewed articles. We found that they were based on the same study, and in an effort to limit duplicate data, we only included the information from the peer-reviewed articles (Reams, 1987; Zion, 1999).
Table 1 displays some of the important variables that were coded. PT was coded as a zero and TF-CBT was coded as a one. Sexual abuse was coded as a zero and physical abuse was coded as a one.
We performed a meta-analysis of effect sizes to combine the various outcome measures used in the articles into five different outcome measures: global, internalizing, externalizing, sexual, and parent report. We decided on these measures because symptoms most often fall under these general categories according to the assessments the researchers gave participants (Carpentier, Silovsky, & Chaffin, 2006; Cohen, Deblinger, Mannarino, & Steer, 2004; Cohen & Mannarino 1998; Cohen, Mannarino, & Knudsen, 2005; Deblinger, Mannarino, Cohen, Runyon, & Steer, 2011; Feather & Ronan 2006; Grasso, Marquez, Joselow, & Webb 2011; Reams & Friedrich, 1994; Reyes & Asbrand, 2005; Scott, Burlingame et al., 2003). A meta-analysis is a procedure in which a set of studies can be combined into one larger study through statistical procedures (Cooper, 2010; Lipsey & Wilson, 2001). This permits the calculation of an overall effect size using all of the studies’ data, resulting in both a more convenient and more objective synopsis of the body of research. In its classical form researchers conducting a meta-analysis calculate an average effect size weighted by the sample size of each study. This gives greater influence to studies with larger sample sizes because a larger sample sizes tends to be more generalizable. A researcher conducting a meta-analysis typically tests the previous studies for heterogeneity in their effect sizes in order to determine if there is a systematic relationship between study characteristics (e.g., age of sample, type of intervention, sample size) and the strength of each study’s effect size.
When there is a choice between pre- and post-test comparison groups and another therapy as the comparison group, the other therapy comparison group is included in the meta-analysis and not the pre- and post-test comparison groups. When several outcome measures that are used to ascertain the same type of outcome are used in the same study the effect sizes are averaged into one effect size for that measure. For example, three effect sizes were calculated from data provided by Reyes and Asbrand (2005). Those effect sizes were then averaged into a single sexual measure. This process was done for all the overlapping measures in each study prior to performing any calculations in the meta-analysis. This was done so that no study would have a disproportionate weight in the final analysis. Separate meta-analyses were conducted for PT and TF-CBT because of the theoretical and practical differences.
Ten articles were found to meet the inclusion criteria and therefore were included in the meta-analysis. These articles consisted of three articles about PT, six about TF-CBT, and one that contained both. Authors of these studies reported 31 effect sizes: 12 effect sizes were for PT outcomes and 23 effect sizes were for TF-CBT outcomes. There were 11 effect sizes for internalizing outcomes (four PT and seven TF-CBT), 11 for externalizing outcomes (four PT and seven TF-CBT), seven for sexual outcomes (two PT and five TF-CBT), and six for parent reported measures (two PT and four TF-CBT). Table two displays the average effect sizes.
We found that TF-CBT had a global average of d = .212 (95% CI = [0.175,.250]), an internalizing average of d = .229 (95% CI = [0.152,.306]), an externalizing average of d = .187 (95% CI = [0.118, .0257]), a sexual average of d = .162 (95% CI = [0.272,.442]), and a parent report average of d = .357 (95% CI = [0.272,.442]). PT had a global average of d = .095 (95% CI = [0.032,.157]), an internalizing average of d =.096 (95% CI = [-0.013,.206]), an externalizing average of d = .255 (95% CI = [0.144,.366]), a sexual average of d = .042 (95% CI = [-0.098,.182]), and a parent report average of d = -0.15 (95% CI = [-0.304,.003]). These average effect sizes are reported in Table three. The table also shows that seven of the ten overall effect sizes were statistically significant (d < .05). All three effect sizes that were not statistically significant were for PT outcomes.
Analysis of Homogeneity
In accordance with standard practice (Cooper, 2010; Lipsey & Wilson, 2001), we performed a test of homogeneity of effect sizes. The effect sizes for the TF-CBT analysis were all homogenous, with Qglobal = 11.173 (df = 22, Qinternalizing = 1.01 (df = 6, p = .985), Qexternalizing = 2.476 (df = 6, p = .871), Qsexual =.362 (df = 4, p = .959), and Qparent = 3.746 (df = 3, p = .290). This shows that all of the effect sizes are statistically equal; we therefore deemed it unnecessary to examine if any study characteristics had an impact on the effect sizes. Figures one and two provide a visual representation of this homogeneity by displaying the effect sizes and CI’s for all outcome measures for both PT and TF-CBT.
The PT results were more heterogeneous, with Qglobal = 38.789 (df = 11, p < .001), Qinternalizing = 6.664 (df = 3, p = .083), Qexternalizing = 7.903 (df = 3, p = .048), Qsexual = 1.23 (df = 1, p = .267), and Qparent = 3.505 (df = 1, p = .061). These results indicate that the effect sizes are not statistically similar, but this is due entirely to the Carpentier et al. (2006) study. Carpentier and colleagues compared PT to TF-CBT and found that TF-CBT was more effective in helping the participants. This caused the effect sizes for PT to be negative, skewing the distribution of effect sizes in the PT results. When the Carpentier et al. (2006) article was eliminated from the results, all of the PT effect sizes were homogeneous. Because all heterogeneity was due to a single article, we did not find it necessary to conduct any of the causes of the heterogeneity. Supplemental figures that display the effect sizes for each of the outcome variables for both TF-CBT and PT are available from the journal’s online archive.
In this study we used meta-analytic techniques to calculate and analyze the effect sizes of the results of studies pertaining to the use of TF-CBT and PT as treatments for child victims of abuse. We found that both participants in both PT and TF-CBT groups had more positive outcomes at the end of the therapy than the control or comparison groups (e.g., other therapy comparisons, pretest/posttest, etc.). Additionally, we found that those who went through TF-CBT treatment had more improvement across all measures—except externalizing outcomes—after therapy than those who went through a PT treatment. This is supported by the 2006 Carpentier et al. article, which showed that TF-CBT was more effective than PT, producing more positive outcomes for participants.
We were not surprised that clients in PT treatments have more improvement with eternalizing outcomes than those clients who were in TF-CBT treatments. This is because PT relies on play as the mode for what is discussed in therapy (Nash & Schaefer, 2011). External behaviors may be more accessible to the therapist conducting PT because the PT therapist will be able to see maladaptive and abnormal behaviors in a play setting. For example, difficulty sharing, violent behaviors, or withdrawal may manifest as a child plays and may be easier for a therapist to target. Another factor that may be involved in this improvement could be that the play therapist sets limits on the child in response to externalizing behaviors. According to Nash and Schaefer (2011), these behaviors include unsafe behaviors, physical aggression, and socially unacceptable behaviors, all of which were classified as externalizing behaviors in this meta-analysis.
Homogeneity of Effect Sizes
A surprising finding was the homogeneity of the effect sizes, especially because in many research studies pretest/posttest designs tend to show larger effect sizes than studies with control groups (Kosters, Burlingame, Nachtigall, & Strauss, 2006). The null hypothesis of homogeneous effect sizes was retained for the TF-CBT studies, indicating that the differences among effect could be due solely to sampling error. There was heterogeneity among the effect sizes for PT, but this was due to the study (Carpentier et al, 2006). Because heterogeneity was largely not present, it was not necessary to conduct analysis on potential moderator variables. This finding is unusual because often heterogeneity among effect sizes if found among meta-analyses (Cooper, 2010).
The homogeneous effect sizes in this meta-analysis have three possible explanations. First, the sampling error does explain the variation among the effect sizes. Both therapies are effective across different age groups, populations, genders, and ethnicities. The second potential reason for homogeneity may be due to our decision to average effect sizes within studies if they measured the same type of outcome (e.g., externalizing outcomes, sexual outcomes). This may reduce variability of effect sizes and make the null hypothesis of homogeneity harder to reject. Another methodological artifact in the meta-analysis may arise from how the original studies were designed. Most, if not all, of the studies in this meta-analysis were designed and conducted by researchers who are practitioners or proponents of the therapies under investigation (Cohen & Mannarino, 2008). This may lead the original authors to inadvertently design studies that are simply more likely to show benefits of TF-CBT and PT. This would be a form of an expectancy effect (Neuman, 2012).
As with all meta-analyses, the validity of this study is only as strong as the studies included for analysis; “we may not like all of the ingredients that go into the sausage, but the [meta-analytic] chef can only work with the ingredients provided by the literature” (Thompson & Vacha-Haase, 2000). The total number of articles included for meta-analysis is small. This is due to the focused nature of this study. Many articles are available about PT, TF-CBT, and child abuse victims, but there are few empirical articles available about the effectiveness of these therapies with child survivors of abuse. The small number of studies was further reduced because TF-CBT and PT were analyzed in separate meta-analyses.
Because studies performed with a wait-list control group were completely absent from the literature, we were missing an ingredient in this meta-analytic “sausage.” The original authors of the articles in this meta-analysis always compared the TF-CBT or PT groups to either the same clients’ baseline scores of the outcomes or another group in a different therapy. This precludes the possibility of studying the absolute effectiveness of either therapy. Because sometimes, as the old proverb says, “time heals all wounds,” it is possible that the outcomes observed in this meta-analysis are not any more positive than what would be observed if the clients were on a wait-list. Conducting a true experiment (an experiment that requires a treatment and random assignment) with a pre- and posttest and a wait-list control group would provide the most rigorous results. However, not providing therapy to those who are suffering may be considered unethical for many therapists because early treatment is associated with greater positive outcomes for the client (Hetzel-Riggin et al., 2007).
Child victims of any form of trauma deserve to have the best treatments available to them, but the research on these therapies is not rigorous enough. TF-CBT and PT are the most widely used therapies in aiding this group of clients (Kaduson, 2011; Misurell et al., 2011; Scott et al., 2003), but we were surprised by the lack of empirically based studies that supported treatments for aiding child victims of abuse. Additionally, few studies reported the average age of abuse, length of abuse, severity of abuse, or even the relationship to the abuser. All of these variables may influence the client’s recovery. If researchers reported these variables, we might be able to examine the relationship between abuse length and treatment success, or if the abuse length impacted the effectiveness of a treatment in aiding the victim’s recovery. Logically, it is hypothesized that the more severe the abuse, the more severe the damage to the abused, and therefore, would impact treatment path. But if this information is not reported, then a relationship cannot be discovered.
Based on the results of this meta-analysis, when administered correctly, the idea that neither TF-CBT nor PT harms clients is greatly supported. Both forms of therapy produce more favorable results than the comparison groups. Because PT seems to have more effect on externalizing problems, it may be of more use when dealing with children who have more severe externalizing behavioral problems. However, if the child is having additional problems, then TF-CBT may be more effective. This is important information for those who regularly work with abused children.
We recommend several changes to how research on this sensitive population is conducted and reported in the future. First, researchers should collect and report data about child clients’ trauma etiology and any past history of abuse, including length and relationship to abuser. Second, when ethically possible, researchers should conduct true experiments with a waitlist control group. Finally, given the relatively small combined sample size in this meta-analysis (n = 762), we urge other researchers to consider replication studies (Makel & Plucker, 2014, and Warne, 2014,). This allows researchers to mitigate any methodological artifacts in previous studies and show the impact of treatment across several groups.
This research was funded by a grant awarded by Utah Valley University’s Student Undergraduate Research Fellowship (SURF). This article is based on the first author’s senior honors thesis. We acknowledge the feedback and support of Matthew Draper, Steven Clark, and Kate McPherson.
References marked with an asterisk indicate studies included in the meta-analysis.
- Arnkoff, D. B., & Glass, C. R. (1992). Cognitive therapy and psychotherapy integration. In D. K. Freedheim (Ed.), History of psychotherapy (pp. 657-694). Washington, DC: American Psychological Association.
- Barnett, O. W., Miller-Perrin, C. L., & Perrin, R. D. (2011). Family violence across the lifespan an introduction (3rd ed.). Thousand Oaks, CA: Sage.
- *Carpentier, M. Y., Silovsky, J. F., & Chaffin, M. (2006). Randomized trial of treatment for children with sexual behavior problems: Ten-year follow-up. Journal of Counseling and Clinical Psychology, 74(3), 482-488.
- Classen, C. C., Cavanaugh, C. E., Kaupp, J. W., Aggarwal, R., Palesh, O. G., Koopman, C., Kaupp, C., Kraemer, H. C., Aggarwal, R., & Spiegel, D. (2011). A comparison of trauma-focused and present-focused group therapy for survivors of childhood sexual abuse: A randomized controlled trial. Psychological Trauma: Theory, Research, Practice, and Policy, 3(1), 84-93.
- *Cohen, J. A., Deblinger, E., Mannarino, A. P., & Steer, R. A. (2004). A multisite, randomized, controlled trial for children with sexual abuse-related PTSD symptoms. Journal of American Academic Child Adolescent Psychiatry, 41(4)3, 393-402.
- Cohen, J. A., & Mannarino, A. P. (2008). Trauma-focused cognitive behavioral therapy for children and parents. Child and Adolescent Mental Health, 13(4), 158-162.
- *Cohen, J.A., & Mannarino, A. P. (1998). Interventions for sexually abused children: Initial treatment outcome findings. Child Maltreatment, 3(1), 17-26.
- *Cohen, J. A., Mannarino, A. P., & Knudsen, K. (2005). Treating sexually abused children: 1 year follow-up controlled trial. Child Abuse & Neglect, 29(2), 135-145.
- Cooper, H. (2010). Research synthesis and meta-analysis. Thousand Oaks, CA: Sage.
- *Deblinger, E., Mannarino, A. P., Cohen, J. A., Runyon, M. K., & Steer, R. A. (2011). Trauma-focused cognitive behavioral therapy for children: Impact of trauma narrative and treatment length. Depression and Anxiety, 28(1), 67-75.
- Dubowitz, H., Newton R. R., Litrownik A. J., Lewis, T., Briggs, E. C., Thompson, R., English, D., Lee, L., Feerick, M. M. (2005). Examination of a concept model of child neglect. Child Maltreatment, 10(2), 173-189.
- Dubowitz, H., Papas, M. A., Black, M. M., & Starr, R. H. (2002). Child neglect: Outcomes in high-risk urban preschoolers. Pediatrics, 109(6), 1100-1107.
- Easton, S. D., Coohey, C., O’leary, P., Zhang, Y., & Hua, L. (2011). The effect of sexual abuse on psychosexual functioning during adulthood. The Journal of Family Violence, 26(1), 41-50.
- *Feather, J. S., & Ronan, K. R. (2006). Trauma-focused cognitive behavioural therapy for abused children with posttraumatic stress disorder: A pilot study. New Zealand Journal of Psychology, 35(3), 132-145.
- Gil, E. (2011). Family play therapy: Igniting creative energy, valuing metaphors, and making changes from the inside out. In C. Schaefer (Ed.), Foundations of play therapy (pp. 207-225). Hoboken, NJ: John Wiley & Sons.
- Ginsberg, B., G. (2011). Congruence in nondirective play and filial therapy: Response to Ryan and Courtney. International Journal of Play Therapy, 20(3), 109-123.
- Glass, C. R., & Arnkoff, D. B. (1992). Behavior therapy. In D. K. Freedheim (Ed.), History of psychotherapy (pp. 587-656). Washington, DC: American Psychological Association.
- *Grasso, D., J., Marquez, Y., Joselow, B., & Webb, C. (2011). Evidence based case study trauma-focused cognitive behavioral therapy of a child with posttraumatic stress disorder. Psychotherapy, 48(2), 188-197.
- Green, E., J. (2008). Reenvisioning Jungian analytical play therapy with child sexual assault survivors. International Journal of Play Therapy, 17(2), 102-121.
- Green, E. J. (2011). Jungian analytical play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 61-85). Hoboken, NJ: John Wiley & Sons.
- Hetzel-Riggin, M. D., Brausch, A. M., & Montgomery, B. S. (2007). A meta-analytic investigation of therapy modality outcomes for sexually abused children and adolescents: An exploratory study. Child Abuse & Neglect, 31(2), 125-141.
- Kaduson, H. G. (2011). Release play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 105-126). Hoboken, NJ: John Wiley & Sons.
- Kosters, M., Burlingame, G. M., Nachtigall, C., & Strauss, B. (2006). A meta-analytic review of the effectiveness of inpatient group psychotherapy. Group Dynamics: Theory, Research, and Practice. 10(2), 146-163.
- Levy, A. J. (2011). Psychoanalytic approaches to play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 43-59). Hoboken, NJ: John Wiley & Sons.
- Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
- Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43(6), 304-316.
- Misurell, J. R., Springer, C., & Tryon, W. W. (2011). Game-based cognitive-behavioral therapy (GB-CBT) group program for children who have experienced sexual abuse: A preliminary investigation. Journal of Child Sexual Abuse, 20(1), 14-36.
- Munns, E. (2011). Theraplay: Attachment-enhancing play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 275-296). Hoboken, NJ: John Wiley & Sons.
- Nash, J. B., & Schaefer, C. E. (2011). Play therapy: Basic concepts and practices. In C. Schaefer (Ed.), Foundations of play therapy (pp. 3-13). Hoboken, NJ: John Wiley & Sons.
- Neuman, W. L. (3rd). (2012). Basics of social research: Qualitative and quantitative approaches. Upper Saddle River, NJ: Pearson.
- Nolan, M., Carr, A., Fitzpatrick, C., O’Flaherty, A., Keary, K., Turner, R., O’Shea, D., Smyth, P., & Tobin, G. (2002). A comparison of two programmes for victims of child sexual abuse: A treatment outcome study. Child Abuse Review, 11(2), 103-123.
- Norton, C. C., & Norton, B. E. (2011). Experiential play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 187-203). Hoboken, NJ: John Wiley & Sons.
- Oaklander, V. (2011). Gestalt play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 171-186). Hoboken, NJ: John Wiley & Sons.
- O’Connor, K. O. (2011). Ecosystemic play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 253-272). Hoboken, NJ: John Wiley & Sons.
- Reams, R. (1987). The efficacy of time-limited play therapy with maltreated preschoolers (Unpublished doctoral dissertation). University of Washington, Seattle, WA.
- *Reams, R., & Friedrich, W. (1994). The efficacy of time-limited play therapy with maltreated preschoolers. Journal of Clinical Psychology, 50(6), 889-899.
- *Reyes, C. J., & Asbrand, J. P. (2005). A longitudinal study assessing trauma symptoms in sexually abused children engaged in play therapy. International Journal of Play Therapy, 14(2), 25-47.
- Saywitz, K. J., Mannarino, A. P., Berliner, L., & Cohen, J. A. (2000). Treatment for sexually abused children and adolescents. American Psychologist, 55(9), 1040-1049.
- *Scott, T. A., Burlingame, G., Starling, M., Porter, C., & Lilly, J. P. (2003). Effects of individual client-centered play therapy on sexually abused children’s mood, self-concept, and social competence. International Journal of Play Therapy, 12(1), 7-30.
- Sweeney, D. S. (2011). Group play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 227-252). Hoboken, NJ: John Wiley & Sons.
- Sweeney, D. S., & Landreth, G. L. (2011). Child-centered play therapy. In C. Schaefer (Ed.), Foundations of play therapy (pp. 129-152). Hoboken, NJ: John Wiley & Sons.
- Swenson, C., C., Schaeffer, C., M., Henggeler, S., W., Faldowski, R., & Mayhew, A., M. (2010). Multisystemic therapy for child abuse and neglect: A randomized effectiveness trial. Journal of Family Psychology, 24(4), 497-507.
- Tighe, A., Pistrang, N., Baruch, G., Casdagli, L., & Butler, S. (2012). Multisystemic therapy for young offenders: Families’ experiences of therapeutic processes and outcomes. Journal of Family Psychology, 26(2), 187-197.
- Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics: The test is not reliable. and Psychological Measurement, 60(2), 174-195.
- Trickett, P. K., Negriff, S., Ji, J., & Peckins, M. (2011). Child maltreatment and adolescent development. Journal of Research on Adolescence, 21(1), 3-20.
- United States Department of Health and Human Services. (2006). Child maltreatment 2004: Reports from the states to the National Child Abuse and Neglect Data Systems—National statistics on child abuse and neglect.
- VanFleet, R. (2011). Filial therapy: Strengthening family relationships with the power of play. In C. Schaefer (Ed.), Foundations of play therapy (pp. 153-169). Hoboken, NJ: John Wiley & Sons.
- Warne, R. T. (2014). Two additional suggested reforms to encourage replication studies in educational research. Educational Researcher, 43(9), 465.
- Zion, T. (1999). Effects of individual client-centered play therapy on sexually-abused children’s mood, self-concept, and social competence (Unpublished doctoral dissertation). Brigham Young University, Provo, UT.
JYI has received funding support from several sources, including the Burroughs Wellcome Fund, the National Science Foundation, and Duke University.