Readability Assessment of Patient-Centered Outcomes Research Institute Public Abstracts in Relation to Accessibility
In 2010, the Patient-Centered Outcomes Research Institute (PCORI) was established by the Affordable Care Act (ACA) to fund and promote consumer-driven research, designed to enhance public access to the health information needed to make decisions consistent with desired outcomes.5 In an attempt to promote access and use of PCORI initiatives’ information, investigators are required to submit a public abstract of their research written in plain language that the general public can understand. These public abstracts are intended to promote general understanding of research, so the success of PCORI’s goal of general accessibility hinges on the readability of these abstracts. Currently, PCORI guidelines provide no quantifiable methods for readability assessment.
This study evaluates how well PCORI has met its plain language mandate by assessing the literacy demand and readability of the posted public abstracts of all funded PCORI research projects between 2012 and 2016. We accessed a total of 780 public abstracts of funded studies from the PCORI website. We applied the Flesch-Kincaid readability measure to the abstracts to establish the grade equivalent demand of the text based on sentence length and syllables per word.6 The mean number of words per sentence was also calculated and compared with the Program for Readability in Science and Medicine (PRISM) recommendation of 15 words or fewer per sentence.7 In addition, common technical terms identified by the Centers for Disease Control and Prevention (CDC) Plain Language Thesaurus for Health Communications as having suitable plain language equivalents were found in the abstracts to demonstrate changes that authors can make to improve the accessibility of their research.8
The findings of this study indicate that current PCORI abstracts are beyond the average literacy level and that protocol is needed to ensure public accessibility. The average reading level of the PCORI abstracts was 15.97 and the average number of words per sentence was 24.86. No abstract met the NIH readability target of 6th grade or below and only one was below the recommended ceiling of 8th grade equivalent. Just 3.2% of the abstracts met the PRISM sentence length recommendation. We found an average of 21.4 technical words with plain language equivalents per abstract (Table).
Although the PCORI mission is to promote consumer-driven research and enhance public access to quality information to make health decisions, abstracts with high literacy demands fall short of ensuring access. To improve PCORI abstract readability and further the goal of enhanced public access to information, this work poses that PCORI should add quantifiable readability metrics to its public abstract requirements, similar to the requirements for informed consent documents. PCORI could provide resources such as the CDC Plain Language Thesaurus and the PRISM toolkit to improve literacy demand and readability. Although we do not know if requiring plain language and reasonable literacy demand for public abstracts will lead to greater public engagement, these criteria ensure the accessibility of the information and thereby promote the objectives of the PCORI mission.