Abstract
BACKGROUND: Visual problems can negatively affect visual development and learning but often go undetected. We assessed the feasibility of scaling up a school-based screening program to identify and treat kindergarten children with visual problems.
METHODS: We conducted a prospective cohort study offering vision screening to junior (JK) and senior kindergarten (SK) children attending 43 schools in 15 Ontario communities. Screening comprised photoscreeners and tests of visual acuity, stereoacuity and eye alignment. Children who failed any test were referred for a comprehensive eye examination, with treatment as needed (e.g., glasses).
RESULTS: Using a passive consent model, 89% of children were screened compared with 62% using an active consent model (p < 0.001). Referral rates to an optometrist varied across schools (mean referral rate for children in JK 53%, range 25%–83%; mean referral rate for children in SK 34%, range 12%–61%). Among 4811 children who were screened, a visual problem was detected in 516 (10.7%), including 164 (3.4%) with amblyopia and 324 (6.7%) with clinically significant refractive errors. For 347 (67.2%) of the children with a visual problem, this was their first eye examination. Rescreening in Year 2 did not lead to detection of additional problems among children who passed screening in Year 1. Regardless of location (child’s school or optometrist’s office), 1563 (68.9%) of children attended the follow-up optometry examination. Most of the children who were surveyed (291 of 322, 90.4%) indicated that they enjoyed vision screening.
INTERPRETATION: Many children in Ontario with a visual problem were not being identified by the status quo in 2015–2017. We found that in-school vision screening with follow-up eye examinations is an effective strategy for identifying at-risk children and placing them in eye care before grade 1.
Two previous Canadian studies suggested that about 1 in 5 children aged 3–6 years have a visual problem such as amblyopia or clinically significant refractive errors (i.e., hyperopia, myopia, astigmatism or anisometropia).1,2 Population-based studies in the United States and other countries have reported similar prevalence.3–15 The United States Preventive Services Task Force recommends at least 1 vision screening in children between the ages of 3 and 5 years.16 The Canadian Paediatric Society recommends screening for visual problems at well-child visits for children aged 3–5 years;17 however, this often does not occur.18 One report from Ontario showed that only 14% of children under 6 years of age had a comprehensive eye examination in 2013, even though examinations are paid for by provincial health insurance.19 The underutilization of vision care means that children with amblyopia are not receiving treatment when it is most effective (i.e., before 8 yr of age).20–22 In addition, early visual problems can negatively affect learning — children with amblyopia read more slowly than those with normal vision,23,24 and refractive errors are associated with poor reading by grade 1.25–31
We are unaware of any studies to date that have examined the scaling and implementation issues associated with a school-based, vision-screening program in kindergarten, or whether such a program could successfully identify and offer treatment (e.g., glasses) to children with previously undiagnosed visual problems.32–34 In a study1 in 1 school (n = 709 children), we investigated what combination of screening tools provided the highest sensitivity and specificity. In the current study, we used this information to test the feasibility of scaling up vision screening to multiple schools in diverse Ontario communities. We investigated whether screening should be offered in both junior kindergarten (JK) and senior kindergarten (SK), whether using an active or passive consent model makes a difference, whether offering follow-up eye examinations at the child’s school can reduce barriers to access, and whether children are receptive to a screening program. These are practical details needed by funders to make decisions about implementing school-based vision screening.
Methods
Study participants and design
Participants were JK (4 yr of age) and SK (5 yr of age) children who attended 43 schools in 15 communities in Ontario (n = 5884 children) from October 2015 to June 2017. The sample population was diverse: urban, suburban and rural communities; schools with small and large enrolment; and public and separate school boards. For 9 school boards (31 schools), we used a passive consent model (children were screened unless parents submitted an opt-out form), whereas 3 school boards (12 schools) required active consent (children were screened only when parents returned a signed consent form).
Based on previous studies35–40 and a concurrent study,1 we used an acuity test (Cambridge Crowded Acuity Cards), 2 photoscreeners (Plusoptix S12 and Spot Vision Screener photoscreeners) and 2 measures of binocular vision (Preschool Randot Stereoacuity test and Pediatric Vision Scanner [PVS]) because they have high accuracy in identifying children with visual problems1 (Appendix 1, available at www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.191085/-/DC1).
We collaborated with pre-existing screening programs whenever possible. If no pre-existing program was available, we hired screeners. Training was provided by authors M.N. and D.M. to ensure compliance with the research protocol. We hired a local coordinator in each community for administrative duties who was trained by author M.N. or the central coordinator from our concurrent study.1
We considered children who met any referral criterion (Table 1) as a “refer” and only children who passed all 5 tests as a “pass.” We based referral criteria on the 2013 guidelines of the American Association of Pediatric Ophthalmology and Strabismus (AAPOS),41 previously published norms42 and our own data.1 Children who did not understand or were uncooperative were considered a refer, because such children have a higher risk of having a vision disorder,43 and we reported the frequency for each screening test. In August 2018, the Ontario Ministry of Health and Long-Term Care (MOHLTC) released a protocol for vision screening in children in SK as part of the Ontario Public Health Standards (2017). We reanalyzed data from Year 1 using only the data from acuity, stereoacuity and 1 photoscreener, the tests mandated by this protocol, using the referral criteria in Table 2, and reported these findings separately.
Children who did not pass screening were booked for a comprehensive eye examination with a licensed optometrist. For all schools in Year 1 and a subset in Year 2, the eye examination was at the school. For 19 schools, the appointment was at the school in Year 1 and at the optometrist’s office in Year 2, allowing a comparison of compliance. Optometrists were masked to the screening results to reduce bias.
The definition of amblyopia and its risk factors (binocular vision disorders and clinically significant refractive errors) are shown in Table 2 and they follow the AAPOS (2013) guideline41 for children aged 31–72 months and the clinical judgment of author A.W. For children screened in both JK and SK, we included only the findings from JK in the calculation of the number of children with visual problems.
In 6 schools in Year 2, we collected responses from 322 children about what they thought of the “vision games.” They were given a private space to circle the face (Appendix 1, Supplemental Figure 1) that matched their assessment (happy = fun, neutral or sad = not fun).
We estimated the costs of screening for 1 city from those in this feasibility study (Appendix 1, Supplementary Table 1).
Statistical analysis
We used descriptive statistics to analyze trends observed in implementing vision screening: referral rates, opt-out rates, participation rates in follow-up eye examinations and frequency of finding a visual problem. Rates were analyzed at the school level and summarized for the overall cohort as the mean and range of school-level rates. Because the PVS was a prototype not commercially available, we analyzed the results from screening with PVS data included and excluded. We used SPSS Statistics software (IBM, version 25) to conduct paired-samples t tests to compare means between groups in the same schools (i.e., JK v. SK; in-school v. in-office follow-up examinations). We used an independent-samples t test to compare the percentage of students who were screened in active versus passive consent models (equal variances were not assumed). We also conducted post hoc analyses using information available from the Internet to determine whether family income or immigration status might explain the variability in referral rates across schools.
Ethics approval
The study was approved by the Research Ethics Boards of The Hospital for Sick Children and McMaster University, as well as school board research ethics committees when required. The PVS was used with authorization from Health Canada.
Results
We screened children at 31 schools in Year 1 and 37 schools in Year 2 (25 of which participated in Year 1; Figure 1) and a summary of the results is provided in Table 3 (from the first year in which we screened at each school). We report the mean and range per school, across the 43 schools.
Screening typically took 15–20 minutes per child. On average, 6.9% (range 1.5%–14.3%) of children missed screening because of absence. In schools using passive consent (n = 31), 4% of parents opted out of screening and an average of 82.1% of children were screened (range 45.8%–98.0%). In schools requiring active consent (n = 12), 8% of parents opted out but 22% failed to return the consent form and, hence, prevented the child from being screened. As a result, an average of only 64.0% of children were screened (range 45.8%–81.6%). Therefore, more children were screened when a passive consent model was used (p < 0.001).
Refer rates varied across schools (Table 3). The mean was 56.2% (range 29.8%–80.3%) when PVS data were included and 43.5% (range 21.8%–72.9%) when they were excluded. Consistent with our concurrent study,1 the mean referral rate was significantly higher for children in JK than SK (p < 0.001), both with PVS data included (JK mean 64.2%; range 34.5%–96.6% v. SK mean 48.2%, range 21.6%–72.2%; Table 4), and with PVS data excluded (JK mean 53.3%, range 25.0%–82.8% v. SK mean 34.4%, range 11.9%–61.3%; Figure 2).
We compared compliance with follow-up eye examinations in 2 cohorts of children in JK who were referred for follow-up examinations (n = 778; Appendix 1): those who had in-school examinations (Year 1) versus those who had in-office examinations (Year 2). Among them, 155 of 778 (19.9%) children did not attend the follow-up examination but were already under the care of an optometrist. Therefore, we excluded their data from this analysis. Attendance was similar in the 2 models (Figure 3): 69.1% of students who were referred attended in-school appointments (range 50.0%–100.0% per school) and 69.4% attended in-office appointments (range 25.0%–100.0%). Thus, regardless of the location of the follow-up examination, at least two-thirds of the referred children not already under care had an eye examination as a result of our program.
Because we found no difference between in-school and in-office examinations, we evaluated compliance with follow-up examinations in all referred children over 2 years for all 43 schools (counting only the JK results for students screened twice). Of 2662 referrals, 15% of parents indicated that their child was already under care (similar to previously published rates19). When we excluded the 392 children already under care, 1563 of the remaining 2270 referred children (68.9%) attended the optometry examinations, 222 (9.8%) had parental consent but did not show up for the examination, 88 (3.9%) opted out and 397 (17.5%) did not return the permission form.
The percentages of screened children who were found to have visual problems through the vision screening program (when screened for the first time, n = 4811) are shown in Table 5. In our sample population, 516 children (10.7% of children who were screened) were identified as having a visual problem; of those children, the parents of 347 (67.2%) reported that this was their child’s first eye examination. Amblyopia was diagnosed in 164 children (3.4%) for which they received treatment. A total of 458 children were prescribed glasses (9.5% of screened children). Astigmatism was the most common reason for prescribing glasses and was diagnosed by the optometrist in 227 (4.7%) screened children.
The results from a single cohort of 747 children who were eligible in both JK and SK were compared in 22 schools where we offered screening over 2 consecutive years and for which individual data were available for both years. In Year 1, 78 children (10.4%) were identified during the follow-up eye examination as having a visual problem. In Year 2, that number was reduced to 23 children (3.1%), 18 of whom were not screened in Year 1 (because of absences or opting out of screening). Of the 277 children who passed screening in Year 1, 41 were referred in Year 2 and, of those 41 who were referred, 16 were examined by an optometrist and did not have a visual problem.
We reanalyzed data from Year 1 using only the data from acuity, stereoacuity and Spot photoscreener tests (Table 6; results were similar when Plusoptix data were used instead). We excluded the results for 77 children who were already wearing glasses (3.1%) from this analysis because they were not tested with the photoscreener. If only children who failed acuity, stereoacuity and the photoscreener testing were referred, this would have reduced the number of referrals from 928 of 2434 in Year 1 (38.1% of screened children) to just 106 (4.3% of screened children). When children failed all 3 tests, 62 of the 71 children who were examined by an optometrist had a visual problem (87.3%), compared with 53 of 237 (22.4%) children who were examined and who failed only acuity.
Only 0.9%–4.2% (depending on the test) of screened children were unable to complete a test (because the child did not understand the test, did not give the correct response even at the easiest test levels or the electronic device was unable to take a measurement; Table 7). Among these children who were examined by an optometrist, 25.0%–51.4% (3–29 children, depending on the test) were found to have a visual problem, a rate higher than the 35.3% (442 of 1251 children) observed among all children who were examined (except for screening by using the Spot photoscreener).
Of the 322 children who were surveyed on their feelings about playing the vision games, 291 (90.4%) chose the happy face (indicating that they found the testing fun), 23 (7.1%) chose the neutral face and 8 (2.4%) chose the sad face.
The screening tests have been reliable over the 5 years we have used them, with minimal repairs (e.g., replacing broken 3-dimensional polarized glasses). Based on a projection over 5 years for the city of Hamilton, Ontario, we estimated the cost of vision screening to be roughly $10 per child (Appendix 1, Supplementary Table 1).
Our post hoc analyses showed large variations in the average household income across the 43 neighbourhoods in which the schools were located (mean household income $86 639, range $39 509–$282 073). We also found large variations in the percentage of students who did not speak English as their first language in each school (mean 24.3%, range 0.0%–85.0% per school) or were born in Canada (mean 89.0%, range 55.0%–100.0% per school). We determined that none of these measures correlated with referral rates: average income (r = −0.17, p = 0.3), percentage of children whose first language was not English (r = 0.16, p = 0.3) and those born in Canada (r = −0.26, p = 0.09).
Interpretation
Our objective for this study was to determine if a school-based screening program can be scaled up across diverse communities to identify children in kindergarten with visual problems and arrange for them to receive follow-up eye examinations and treatment. Most parents provided consent for their child to participate in vision screening. Although referral rates varied across schools, just under half of the children who were screened were referred for follow-up eye examinations, and referral rates were higher for children in JK than for those in SK. As a result of the follow-up examinations, more than 10% of the children who were screened were identified as having a visual problem, most for the first time. Thus, a school-based vision screening program can be an effective population intervention for reducing untreated visual problems that otherwise might lead to amblyopia or affect learning.
Our study provides several important pieces of information for optimizing implementation. We found little added value in requiring a child to undergo screening in both JK and SK, because this doubles the needed resources for screening and increases the number of follow-up examinations and few children with problems would be newly identified. We chose an arbitrarily strict criterion that only children who passed all tests were considered a “pass” — all other children were referred for an eye examination. One consideration to minimize overreferrals would be to arrange follow-up examinations (i.e., actually book the appointment) for children who fail multiple screening tests and simply suggest (with a letter) eye examinations for children who fail a single test.
Two-thirds of referred students attended in-school and in-office examinations. Our experience suggests that a key to our success was to prebook the appointments for parents and to ensure that there was no cost to the parents should the child require glasses. It is important that most of the children reported enjoying the “vision games,” which is needed if the program is to be supported by parents and school staff. Additional considerations for optimizing implementation are discussed in Appendix 1.
Limitations
We did not collect individual demographic data (e.g., socioeconomic status, ethnicity and parental education) that might have explained the variability in referral rates across schools and cohorts. In addition, there were 23 instances (0.4% of all screenings) of erroneous pass letters that were sent home when the child had failed screening. Because no screening is perfect, our pass letters explained that screenings do not replace comprehensive eye examinations and included the office information of our collaborating optometrist to facilitate booking of examinations by parents, especially if their child had never had one.
Conclusion
Through our program, about 1 in 10 children who were screened were identified as having a visual problem, with most identified for the first time. These numbers show that the status quo (in 2015–2017) was insufficient in identifying and treating young children with a visual problem before grade 1. The willingness of school boards and principals to participate in our study underlines the recognized need for better access to visual health care for children in kindergarten. The success of any vision screening program depends on the extent of the follow-up care that is provided (i.e., access to eye care professionals and glasses, reminders for follow-up and information about the importance of early vision care). Implementation can be facilitated by collaborating with existing associations with a mandate to improve children’s eye health and community eye care professionals with offices located close to the school. Despite our efforts, however, nearly one-third of referred children not identified as already under care did not receive the follow-up eye examination we offered, and further research is needed to explore strategies for reducing this number. Nevertheless, our program was successful in assuring vision care for many children with previously unidentified visual problems. A visual screening program for children in SK has been implemented in Ontario, in part as a result of our program.44 Our findings indicate the value of implementing this type of program universally across Canada.
Acknowledgements
The authors thank the Ontario Association of Optometrists for their collaboration in many of the communities, including the recruitment of optometrists and provision of glasses through the Eye See…Eye Learn program (lenses were donated by Nikon and frames were donated by OGI). They thank the Toronto Foundation for Student Success and its Gift of Sight and Sound program for organizing the screeners, optometrists and opticians, as well as for arranging free glasses through their partners for children within the Toronto District School Board (TDSB). They also thank the volunteer screeners who worked with them in many of the communities: Lions Clubs from District A15 in Rockwood, Fergus, Cambridge and Wellesley, Ont.; University of Ottawa’s IScreen Ottawa Interest Group (medical students at the University of Ottawa); personnel from the Timiskaming Health Unit in Kirkland Lake, Ont.; personnel from Lambton Public Health in Sarnia, Ont.; personnel from Southwestern Public Health (formerly Oxford County Public Health) in Woodstock and Ingersoll, Ont.; and third- and fourth-year trainees from the School of Optometry and Vision Science, University of Waterloo. The authors also thank Lisa W. Christian, O.D., (Associate Clinical Professor at the University of Waterloo), Paul Chris, O.D. (Executive Director at Vision Institute of Canada) and Maria Yau, (Research Co-ordinator at Research & Development, TDSB), for their contributions to the design of the study. They thank Wylie Tan, O.D., for supervising the screening conducted by third-year trainees from the University of Waterloo and providing additional optometry examinations when needed. They thank David Hunter and Justin Shaka for the loan of an early Pediatric Vision Scanner prototype, and Mano Chandrakumar and Sally Stafford for their assistance with the logistics of the study.
Footnotes
Competing interests: Agnes Wong has received a grant from the PSI Foundation. No other competing interests were declared.
This article has been peer reviewed.
Contributors: Mayu Nishimura and Daphne Maurer contributed to data acquisition. Mayu Nishimura performed the data analysis. Helen Dimaras contributed expert advice about knowledge translation in communicating with stakeholders and how to collect feedback from children. Mayu Nishimura drafted the manuscript. All authors contributed to the study design and to data interpretation, revised the manuscript critically for important intellectual content, gave final approval of the version to be published and agreed to be accountable for all aspects of the work.
Data sharing: The full data set is available on request from Mayu Nishimura (mayu.nishimura{at}sickkids.ca) or Daphne Maurer (maurer{at}mcmaster.ca) until 7 years after publication, at which time the data will be destroyed and deleted securely in accordance with the data management policies of The Hospital for Sick Children, Toronto.
Funding: This research was supported by a Collaborative Health Research Project grant from the Canadian Institutes of Health Research and the Natural Sciences and Engineering Research Council of Canada to Daphne Maurer and Agnes Wong, a Joanne Angle Investigator Award from Prevent Blindness America to Agnes Wong and private donations.
- Accepted March 20, 2020.