OBJECTIVE
We examined content and construct validity of Here’s How I Write: A Child’s Self-Assessment and Goal Setting Tool, to assess children’s perception of their handwriting and set child-directed goals.
METHOD
In Study 1, a content validity study, 6 occupational therapists and 2 educators assessed the need for this type of measure and examined the proposed items. Thirty-four occupational therapists and educators then completed an online survey examining the items. Study 2, a construct validity study, compared the self-ratings of 20 children with poor handwriting and 20 children with good handwriting in Grades 2–5 with their teachers’ ratings.
RESULTS
Results supported test content and indicated freedom from culture and gender bias. The assessment discriminated between good and poor writers. The relationship between teacher and student ratings was significant, although teachers of poor writers rated the children lower than the children rated themselves.
CONCLUSION
These studies provide support for the tool’s validity.
Proficient handwriting is an essential component of literacy and an important foundation needed to support a child’s academic success. It is estimated that children in elementary school spend 31%–60% of each academic day occupied with fine motor tasks, with the majority of that time involving handwriting (McHale & Cermak, 1992). Research shows that 10%–30% of elementary school children struggle with handwriting (Karlsdottir & Stefansson, 2002). The education literature documents the consequences of poor handwriting for long-term academic performance and future employment (Berlin & Sum, 1988; Sum, Kirsch, & Yamamoto, 2004). Graham, Harris, and Fink (2000) suggested that children who experience difficulty mastering handwriting may avoid writing, potentially leading to a lack of participation in an important daily occupation for children and compromising the long-term outcomes of education.
Occupational therapy practitioners provide schools with universal strategies to support children’s acquisition of good handwriting habits (Case-Smith, Holland, Lane, & White, 2012; Schneck & Amundson, 2010). If a child’s handwriting does not improve through a teacher’s instructional practices, occupational therapy practitioners use a variety of assessments to evaluate the child’s visual–motor readiness and sensory and fine motor foundational skills needed for handwriting (van Hartingsveldt, De Groot, Aarts, & Nijhuis-Van Der Sanden, 2011). Practitioners often recommend specialized developmental handwriting programs, foundational skill building, and materials and environmental adaptations to improve handwriting (Bissell, Fisher, Owens, & Polcyn, 1998; Schneck & Amundson, 2010; Woodward & Swinth, 2002). Occupational therapy research has supported the effectiveness of handwriting interventions (Case-Smith, 2002; Case-Smith et al., 2012; Denton, Cope, & Moser, 2006; Feder & Majnemer, 2007; Howe, Roston, Sheu, & Hinojosa, 2013; Peterson & Nelson, 2003; Weintraub, Yinon, Hirsch, & Parush, 2009, Zwicker & Hadwin, 2009). Moreover, Berninger and Amtmann (2003) provided evidence that handwriting intervention can have a significant impact on other aca demic skills, such as spelling.
In recent years, a trend has developed to involve children in the assessment and intervention process, including self-evaluation and collaboration in setting educationally relevant occupational therapy goals (Missiuna, Pollack, & Law, 2004; Schneck & Amundson, 2010). Research indicates that self-evaluation plays a key role in fostering improved learning and higher degrees of motivation (Alderman, 1990; Toglia, 2011). When students reflect on their performance, it encourages them to set higher goals and commit more effort to achieve them (Rolheiser & Ross, n.d.; Ross, 2006). Moreover, researchers believe that children maximize their achievement in school when they have personal goals to attain, feel they have control over their successes and failures, and are motivated intrinsically to learn (Marchant, Paulson, & Rothlisberg, 2001). Self-assessment promotes opportunities for students to identify their thoughts and feelings about their learning and performance at the cognitive, affective, and operative levels. When children are encouraged to critically analyze their work through reflection and self-assessment, they have the opportunity to take control of their learning. This process promotes self-regulation, in dependence, and a sense of ownership of the learning process, leading to the acquisition, maintenance, and generalization of skills (Graham, Harris, & Mason, 2005; Graham, Harris, & McKeown, 2013; Missiuna et al., 2004; Shapiro, 2011; Young, Yoshida, Williams, Bombardier, & Wright, 1995).
Further, research has indicated that goals established by others are not nearly as motivating as those established by people for themselves. Bandura and Schunk (1981) studied goal attainment and showed that child-centered goal setting was the most effective method of enhancing competencies, self-perceptions of efficacy, and intrinsic interest. This trend of involving the child is in keeping with the earlier writings of Meichenbaum (1977), which emphasized the importance of involving clients as partners in the therapy process (Polatajko & Mandich, 2004) and is consistent with client-centered practice (Fearing & Clark, 2000; Missiuna et al., 2004).
Children’s involvement in the identification of their needs and the selection of their intervention goals is likely to increase their motivation to learn, thereby promoting academic achievement (Graham et al., 2013; Schunk, 1996). Thus, tools that enable student self-assessment and goal setting may elicit more powerful and enduring levels of student engagement in the learning environment (Toglia, 2011; Zlotnik, Sachs, Rosenblum, Shpasser, & Josman, 2009). However, this key component often is missing in formal handwriting assessment and intervention. This article presents two studies that examined the development and validity of Here’s How I Write: A Child’s Self-Assessment and Goal Setting Tool (HHIW; Goldstand, Gevir, Cermak, & Bissell, 2013), which was designed to provide occupational therapy practitioners and educators with an assessment that includes the child in the process of identifying his or her relative strengths and areas of weakness in handwriting and helps the child collaborate in setting goals.
Description of the HHIW
The HHIW was modeled after the original Hebrew language child’s self-assessment of handwriting developed for Israeli Hebrew-speaking children, Kach Ani Kotev (Goldstand & Gevir, 2006, 2012). Kach Ani Kotev was the first pictorial self-assessment tool designed to examine schoolchildren’s perception of their own handwriting skills. The HHIW is a translated, adapted, and elaborated version of the Hebrew handwriting assessment and con sists of a card game interview and goal setting process for English-speaking children. The English version includes child-driven data collection and progress monitoring as part of the process using samples from the child’s existing curriculum assignments.
The HHIW is a criterion-referenced handwriting assessment with standardized administration procedures. It consists of a picture card interview in which the examiner presents a child with 24 cards illustrating various aspects of handwriting, including feelings about handwriting, handwriting performance, and physical factors (Figure 1). Each side of the 24 cards has a positive and a negative attribute, and the examiner asks the child, “Which is more like you?” The examiner then asks the teacher about the same 24 aspects of the child’s handwriting using a checklist format (Figure 2.)
Handwriting Group | ||||||
Good | Poor | |||||
Respondents | M | (SD) | M | (SD) | t(38) | p |
Children | 86.00 | (7.25) | 72.85 | (11.32) | 4.37 | <.0001 |
Teachers | 81.65 | (13.10) | 49.85 | (8.55) | 9.09 | <.0001 |
t(19) | 1.67 | 8.08 | ||||
p | .11 | <.0001 |
Discussion
It is not surprising to find that children who have poor handwriting are indeed aware of their writing ability and feel that their handwriting is not good. Significant differences in ratings were found between the children with good and poor handwriting, both in their self-assessment and in the assessment of their teachers. This finding indicates that children are able to self-assess their own handwriting performance.
However, a discrepancy was found between what children with poor handwriting thought of their handwriting and what their teachers thought, with teachers rating the children lower than children rated themselves. Several interpretations of this finding are possible: The children may have been aware of their problems but unaware of the extent and severity of those problems; the children may have been reluctant to score themselves at the bottom of the rating scale; and the teachers were not blinded to which group the children were in, which might have created a bias such that the teachers rated those children more severely.
Limitations and Future Research
Table 2. Comparison of Mean Scores for Affect, Performance, and Physical Factors for the Good and Poor Handwriting Groups
Handwriting | Group | ||||
Category | Respondents | Good | Poor | t(38) | p |
Affect (Items 1-2) | Children, M (SD) | 6.65 (1.27) | 5.60 (1.64) | 2.69 | .029 |
Teachers, M (SD) | 6.70 (1.22) | 3.40 (1.05) | 9.19 | <.0001 | |
t(19) | 0.16 | 5.99 | |||
p | .87 | <.0001 | |||
Performance (Items 3-21) | Children, M (SD) | 68.65 (5.54) | 57.70 (9.57) | 4.51 | <.0001 |
Teachers, M (SD) | 64.85 (10.26) | 39.30 (7.66) | 8.92 | <.0001 | |
t(19) | 1.933 | 7.24 | |||
p | .06 | <.0001 | |||
Physical Factors (Items 22-24) | Children, M (SD) | 10.30 (1.34) | 9.20 (1.70) | 2.27 | .029 |
Teachers, M (SD) | 10.15 (2.03) | 6.95 (1.85) | 5.20 | .0001 | |
t(19) | 0.31 | 3.98 | |||
p | .76 | .0008 |
Note: M = Mean; SD = Standard Deviation
Implications for Occupational Therapy Practice
In occupational therapy practice, inclusion of a child in assessment, goal setting, and progress monitoring is key to enhancing his or her motivation, performance, and self-efficacy (Graham et al., 2013; Missiuna et al., 2004; Polatajko & Mandich, 2004; Schneck & Amundson, 2010; Toglia, 2011; Zlotnik et al., 2009). The HHIW is a new tool that incorporates these components in handwriting evaluation. The findings described in this article have the following implications for occupational therapy practice (Goldstand et al., 2013):
• This research shows that the HHIW discriminates between children with and without handwriting problems and provides a direct method to identify and address handwriting concerns in the context of a child’s curriculum expectations.
• The assessment can be used with other handwriting assessments and can aid a child’s teachers and occupational therapy practitioners in understanding his or her handwriting needs and developing methods for change.
• The HHIW assessment process develops a child’s self-awareness, self-evaluation, and goal setting ability. Children engaged in the assessment and goal setting process become active, engaged learners.
• The test is an ecologically valid assessment that assesses a child’s handwriting in the context of classroom performance and actively engages both the child and teacher in setting and monitoring goals.
• The test is administered in an engaging child-centered card game interview format reflecting the childhood occupations of play, handwriting, and schoolwork.
• The HHIW is useful in the Response to Intervention and individualized education program literacy and learning process in both general education and special education.
Conclusion
These studies show that children in second to fifth grade are able to self-assess their own handwriting, supporting the validity of the HHIW. The children reported that they enjoyed the card game interview about their handwriting and were interested in participating in a handwriting improvement plan. One student reported that he was happy to have a handwriting test that did not involve writing, and another student stated that she liked talking about her handwriting, including why it mattered and how to make it better. This feedback supports the use of the HHIW as a valuable tool to use as a platform to work in partnership with children and their teachers to better understand how to improve performance in handwriting.
Acknowledgments
We acknowledge Sarina Goldstand and Debbie Gevir, developers of the Hebrew version of the HHIW, and Keith Cross, Milk Row Studio, for his expertise in educational product design and development. Many thanks to Mary Grace Assistant Superintendent, Anaheim City School District, for her support of data-driven services.
References
Alderman, K. (1990). Motivation for at-risk students. Educational Leadership, 48, 27–30.
Amundson, S. J. (1995). Evaluation Tool of Children’s Handwriting: ETCH examiner’s manual. Homer, AK: O.T. Kids.
Bandura, A., & Schunk, D. (1981). Cultivating competence, self-efficacy and intrinsic interest through proximal self motivation. Journal of Personality and Social Psychology, 41, 586–598. http://dx.doi.org/10.1037/0022-3514.41.3.586
Beery, K. E., Buktenica, N., & Beery, N. A. (2006). The Beery Buktenica Developmental Test of Visual–Motor Integration: Beery VMI (5th ed.). San Antonio, TX: Pearson Assessments.
Berlin, G., & Sum, A. (1988). Toward a more perfect union: Basic skills, poor families, and our economic future. New York: Ford Foundation.
Berninger, V., & Amtmann, D. (2003). Preventing written expression disabilities through early and continuing assessment and intervention for handwriting and/or spelling problems: Research to practice. In H. Swanson, K. R. Harris, & S. Graham (Eds.), Handbook of learning disabilities (pp. 345–363). New York: Guilford Press.
Bissell, J., Fisher, J., Owens, C., & Polcyn, P. (1998). Sensory motor handbook: A guide for implementing and modifying activities in the classroom (2nd ed.). San Antonio, TX: Therapy Skill Builders.
Bruininks, R. H. (1978). Bruininks– Oseretsky Test of Motor Proficiency examiner’s manual. Circle Pines, MN: American Guidance Service.
Case-Smith, J. (2002). Effectiveness of school-based occupational therapy intervention on handwriting. American Journal of Occupational Therapy, 56, 17–25. http://dx. doi.org/10.5014/ajot.56.1.17
Case-Smith, J., Holland, T., Lane, A., & White, S. (2012). Effect of a coteaching handwriting program for first graders: One-group pretest–posttest design. American Journal of Occupational Therapy, 66, 396–405. http://dx. doi.org/10.5014/ajot.2012.004333
Denton, P. L., Cope, S., & Moser, C. (2006). The effects of sensorimotor-based intervention versus therapeutic practice on improving handwriting performance in 6- to 11 year-old children. American Journal of Occupational Therapy, 60, 16–27. http://dx.doi.org/10.5014/ajot.60.1.16
Fearing, V. G., & Clark, J. (2000). Individuals in context: A practical guide to client centered practice. Thorofare, NJ: Slack.
Feder, K. P., & Majnemer, A. (2007). Handwriting development, competency, and intervention. Developmental Medicine and Child Neurology, 49, 312–317. http://dx.doi. org/10.1111/j.1469-8749.2007.00312.x
Folio, M. K., & Fewell, R. (2000). Peabody Developmental Motor Scales: Examiner’s manual (2nd ed.). Austin, TX: Pro-Ed.
Goldstand, S., & Gevir, D. (2006). Kach Ani Kotev. Jerusalem: Authors.
Goldstand, S., & Gevir, D. (2012). Kach Ani Kotev (2nd ed.). Jerusalem: Authors.
Goldstand, S., Gevir, D., Cermak, S., & Bissell, J. (2013). Here’s How I Write: A Child’s Self-Assessment and Goal Setting Tool. Framingham, MA: Therapro.
Graham, S., Harris, K., & Fink, B. (2000). Is handwriting causally related to learning to write? Treatment of handwriting problems in beginning writers. Journal of Educational Psychology, 92, 620–633. http://dx.doi.org/10.1037/ 0022-0663.92.4.620
Graham, S., Harris, R., & Mason, L. (2005). Improving the writing performance, knowledge, and self-efficacy of struggling young writers: The effects of self-regulated strategy development. Contemporary Educational Psychology, 30, 207–241. http://dx.doi.org/10.1016/j.cedpsych.2004.08.001
Graham, S., Harris, K. R., & McKeown, D. (2013). The writing of students with learning disabilities, meta-analysis of self-regulated strategy development writing intervention studies, and future directions: Redux. In H. Swanson, K. R. Harris, & S. Graham (Eds.), Handbook of learning disabilities (2nd ed., pp. 405–438). New York: Guilford Press.
Howe, T. H., Roston, K. L., Sheu, C. F., & Hinojosa, J. (2013). Assessing handwriting intervention effectiveness in elementary school students: A two-group controlled study. American Journal of Occupational Therapy, 67, 19–26. http://dx.doi.org/10.5014/ajot.2013.005470
Karlsdottir, R., & Stefansson, T. (2002). Problems in developing functional handwriting. Perceptual and Motor Skills, 94, 623–662. http://dx.doi.org/10.2466/pms.2002.94. 2.623
Marchant, G., Paulson, S., & Rothlisberg, B. (2001). Relations of middle school student’ perceptions of family and school contexts with academic achievement. Psychology in the Schools, 38, 505–519. http://dx.doi.org/10.1002/pits.1039
McHale, K., & Cermak, S. A. (1992). Fine motor activities in elementary school: Preliminary findings and provisional implications for children with fine motor problems. Ameri can Journal of Occupational Therapy, 46, 898–903. http://dx. doi.org/10.5014/ajot.46.10.898
Meichenbaum, D. (1977). Cognitive–behavior modification. New York: Plenum Press.
Missiuna, C., Pollack, N., & Law, M. (2004). The Perceived Efficacy and Goal Setting System. Toronto, Ontario: Psychological Corporation.
Olsen, J. (2012). Handwriting without tears. Cabin John, MD: Handwriting Without Tears.
Olsen, J. Z., & Knapton, E. F. (2006). The Print Tool: The tool to evaluate and remediate. Cabin John, MD: Handwriting Without Tears.
Peterson, C. Q., & Nelson, D. L. (2003). Effect of an occupational intervention on printing in children with economic disadvantages. American Journal of Occupational Therapy, 57, 152–160. http://dx.doi.org/10.5014/ajot.57. 2.152
Polatajko, H., & Mandich, A. (2004). The CO–OP protocol: Doing it. In H. Polatajko & A. Mandich (Eds.), Enabling occupation in children: The cognitive orientation to daily occupational performance approach (pp. 47–106). Ottawa, Canada: CAOT Publishers.
Rolheiser, C., & Ross, J. (n.d.). Student self-evaluation: What research says and what practice shows. Metairie, LA: Center for Development and Learning. Retrieved from http://www.cdl.org/resource-library/articles/self_ eval.php
Ross, A. (2006). The reliability, validity and utility of self assessment. Practical Assessment, Research and Evaluation, 11(10), 1–13. Retrieved from http://pareonline.net/getvn. asp?v511&n510
Schneck, C., & Amundson, S. (2010). Pre-handwriting and handwriting skills. In J. Case-Smith & J. O’Brien (Eds.), Occupational therapy for children (6th ed., pp. 555–580). Maryland Heights, MO: Mosby Elsevier.
Schunk, D. H. (1996). Goal and self-evaluative influences during children’s cognitive skill learning. American Educational Research Journal, 33, 359–382. http://dx.doi.org/ 10.3102/00028312033002359
Shapiro, E. (2011). Academic skills problems: Direct assessment and intervention (4th ed.). New York: Guilford Press.
Sum, A., Kirsch, I., & Yamamoto, K. (2004). Pathways to labor market success: The literacy proficiency of U.S. adults. Prince ton, NJ: Policy Information Center.
Toglia, J. (2011). Cognition, occupation, and participation across the life span. In N. Katz (Ed.), Models for intervention in occupational therapy (3rd ed., pp. 161–201). Bethesda, MD: AOTA Press.
van Hartingsveldt, M. J., De Groot, I. J., Aarts, P. B., & Nijhuis-Van Der Sanden, M. W. (2011). Standardized tests of handwriting readiness: A systematic review of the literature. Developmental Medicine and Child Neurology, 53, 506–515. http://dx.doi.org/10.1111/j.1469-8749.2010. 03895.x
Weintraub, N., Yinon, M., Hirsch, I., & Parush, S. (2009). Effectiveness of sensorimotor and task-oriented handwriting intervention in elementary school-aged students with handwriting difficulties. OTJR: Occupation, Participation and Health, 29, 125–134. http://dx.doi.org/10.3928/15394492 20090611-05
Woodward, S., & Swinth, Y. (2002). Multisensory approach to handwriting remediation: Perceptions of school-based occupational therapists. American Journal of Occupational Therapy, 56, 305–312. http://dx.doi.org/10.5014/ajot. 56.3.305
Young, N. L., Yoshida, K. K., Williams, J. I., Bombardier, C., & Wright, J. G. (1995). The role of children in reporting their physical disability. Archives of Physical Therapy, 76, 913–918. http://dx.doi.org/10.1016/S0003-9993(95)80066-2
Zlotnik, S., Sachs, D., Rosenblum, S., Shpasser, R., & Josman, N. (2009). Use of the Dynamic Interactional Model in self-care and motor intervention after traumatic brain injury: Explanatory case studies. American Journal of Occupational Therapy, 63, 549–558. http://dx.doi.org/10. 5014/ajot.63.5.549
Zwicker, J., & Hadwin, A. (2009). Cognitive versus multisensory approaches to handwriting intervention: A randomized controlled trial. OTJR: Occupation, Participation and Health, 29, 40–48. http://dx.doi. org/10.3928/15394492-20090101-06