Website Evaluation Tool

 Download Your SPAT Guide

[ Current Research ]   [ Conferences ]   [ Journals ]   [ Newsletters ]   [ Workshops & Lectures ]  

SPAT has gone through extensive scientific testing to verify that it works. It has been tested with health care professionals and with laypersons. Everyone has learned from SPAT and found that after learning SPAT they constantly evaluate web pages.

Further research is being done with SPAT and the findings will be posted here when complete. Research in Process

Abstract:
Health is one of the most popular subjects accessed on the World Wide Web. From the Internet people easily access health information and some of these people are turning into information empowered patients. While consumers (laypersons) are accessing information, they may not be accessing quality health information. Because the U.S. has a large population of consumers with health literacy levels that are less than proficient, there is a great need for education and tools to help consumers access quality health information.

There are many web page evaluation tools available but none have been validated; they are too time consuming to use and most require paper and pencil to complete a check list. One tool that does not require paper and pencil, is quick and easy to use, and has shown face validity is SPAT. SPAT is a mnemonic tool used by people to help them pre-evaluate web page health information for accuracy. Findings from a previous pilot study measuring the adoption and usability of the SPAT tool with certified diabetes educators (CDEs), revealed a statistically significant change in the way web pages were evaluated after learning and using SPAT.

To continue testing the validity of the SPAT tool, criterion-related validity needs to be measured. The proposed pretest posttest experimental design pilot study focuses on the training for using the SPAT tool and the application of the SPAT tool by consumers. We expect the results of the proposed study to assist in converting the paper based SPAT instructional sheet to a web-based format and to provide support for future work in examining the impact of SPAT has on self-care behaviors.

[ View Study Presentation ]

Purpose:
This research study proposes to measure the acceptance of a web page assessment tool developed by this investigator. The purpose of this study was to validate the assessment tool's use in analyzing web page content quality and reliability. Setting/subjects:
Certified Diabetic Educators within a metropolitan and semi-rural setting

Brief Description/Methodology:
A case-controlled research design was used to collect data from a convenience sample of 38 Certified Diabetes Educators (CDEs). Each CDE completed a closed-question demographic questionnaire gathering data on their perceived level of skill in accessing information from the Web. To evaluate the effectiveness, and personal usefulness of SPAT, each subject was asked to review two sets of pre-selected freely available diabetes information web pages. After reviewing set one diabetes web pages, the CDE completed a semi-structured questionnaire querying their assessment process. Next, SPAT was verbally introduced by the investigator. Following the introduction of SPAT, set two diabetes web pages were reviewed by the CDE then a second semi-structured questionnaire was completed, thus finishing the formal interview. To complete the study on the adoption of SPAT, a follow-up email was sent approximately three weeks after the introduction of the tool.

Results:
There was no statistical difference found in the CDEs' evaluation of the URL, author, and date, pre-and-post introduction of SPAT. There was statistical significance for evaluating a web page's text and intended audience. While the differences in mean scores between the pre- and post-test were narrow, the near perfect effectiveness of SPAT manipulation is notable as proof that if one knows of the tool SPAT, and uses it they are evaluating a web page. With a 78% return rate for the follow-up questionnaires, 47% of the CDEs changed their evaluation process 'Somewhat' by knowing SPAT. Seven percent said their web page reviewing method changed 'extensively.' Overall, SPAT had made an impact on the way CDEs review web based information.

Discussion:
The findings from this study add to our understanding of the diffusion and adoption of information technology by CDEs and their utilization of the web page evaluation tool SPAT.

[ View Poster ]

Purpose:
The purpose of this poster is to present the process of developing and then validating an instrument for the evaluation of web pages.

Background:
As more users rely on web-based health information there is a growing need to identify reliable information sources. Currently there are a few evaluation approaches but they require paper-based materials for note taking or utilize a subjective ranking system. In each case, these approaches require an extended period of time to assess the web pages and do not provide a validated measure of accuracy or quality.

Methods:
SPAT (Site Publisher Audience Text) has been developed to provide an assessment instrument that will establish the validity and quality of a health-related web page. Initial evaluations of SPAT have been conducted through student focus groups, and user task analysis. To complete the research a pre-and-post test design will be carried out with certified diabetes educators.

Results:
Preliminary results find SPAT to be memorable, functional, and reliably useable for all ages.

Discussion:
SPAT does not require note taking materials and does not have a ranking system for validity and quality. The SPAT instrument guides the user through a systematic process of web page assessment. If the user does what the acronym reminds them to do, they will have performed an inclusive assessment on the quality and validity of the web page.

[ View Coming About Presentation ]

Purpose:
This paper discusses how a library in a private institution can teach consumer health literacy without seeing the public.

Brief Description:
If health care practitioners know how to evaluate Web pages and use MedlinePlus, then they can teach their patients how to find accurate health information from a reliable Internet source. This paper will report how a librarian participated in developing curriculum, secured two hours of lecture time, and assisted in creating homework assignments for a new course offered by the School of Nursing.

Results:
The idea to teach Web page evaluation techniques, and consumer health literacy to nursing students was proposed to the School of Nursing when they were developing a new course on health information on the Internet. The vice dean for the School of Nursing contacted the library asking for a participant in establishing the curriculum for the new course, Web-based Health Information for Consumer Education. The librarian worked with two faculty members to develop the course outline and was able to secure time for a two-hour librarian lecture. In preparation for the lecture a Web page evaluation tool (SPAT) was developed.

Evaluation:
Following the lecture on the consumer use of health information from the Internet, health literacy, and the methodology of SPAT, a homework assignment was given to reinforce the lecture. Student's comments were very positive and indicated that they had, and will have, opportunities to use MedlinePlus and Web page evaluation techniques with patients during their clinical work. The faculty member leading the course and the faculty member attending the class both remarked favorably on the lecture and class exercise.

back to top

[ Purchase Article ]

[ View Complete Newsletter ]  [ View Article Only ]

[ View Workshop Presentation ]