Open Journal of Preventive Medicine
Vol.07 No.10(2017), Article ID:80049,14 pages
10.4236/ojpm.2017.710017

Accuracy of Ebola Information in a Knowledge Exchange Social Website (KESW)

Fiona Gorman1*, Desa Yadegarians1, Taufa Islam1, Simon Tongco2, Esther Johnston3, Elma Estrada2, Nicholas Gorman4

1California State University, Long Beach, USA

2California State University, Fullerton, USA

3The Wright Center National Family Medicine Residency at Health Point, Auburn, USA

4Keck Graduate Institute, Claremont, USA

Copyright © 2017 by authors and Scientific Research Publishing Inc.

This work is licensed under the Creative Commons Attribution International License (CC BY 4.0).

http://creativecommons.org/licenses/by/4.0/

Received: September 11, 2017; Accepted: October 28, 2017; Published: October 31, 2017

ABSTRACT

Background: Misinformation on interactive Knowledge Exchange Social Websites (KESWs) is concerning since it can influence Internet users’ health behaviors, especially during an infectious disease outbreak. Objective: The present study seeks to examine the accuracy and characteristics of health information posted to a Knowledge Exchange Social Website (KESW). Methods: A sample of 204 answers to Ebola questions were extracted and rated for accuracy. Multiple logistic regression modeling was used to examine whether answer characteristics (best answer, professional background, statistical information, source disclosed, link, and word count) predicted accuracy. Results: Overall, only 27.0% of the posted answers were rated as “accurate”. Accuracy varied across question topics with between 11.8% - 45.5% of answers being rated as accurate. When Yahoo Answers’ “best answers” were examined, the overall accuracy was substantially higher, with 80.0% of “best answers” being rated as accurate compared to 16.0% of all other answers. Conclusion: There is need for tools to help Internet users navigate health information posted on these dynamic user-generated knowledge exchange social websites.

Keywords:

Online Health Information, Ebola, Infectious Diseases, Accuracy, Knowledge Exchange Social Websites

1. Introduction

The popularity of the Internet as a discreet, readily available source of health information is evidenced by data showing that up to 75% of adults in the U.S. report having used a search engine to look up health information [1] , with over half of adults (56.8%) having reported seeking health information online in the past month [2] . Daily, approximately three times as many people search for health information online compared to consulting physicians at office visits [3] .

Despite the popularity of online health resources, past research has shown that both the quality [4] [5] and readability level [4] of health-related websites varies widely, with incomplete information and inaccuracies compromising the information available to readers [6] .

The presence of poor, incomplete, or misleading information is troubling given the low levels of electronic health literacy (eHealth Literacy) reported among Internet users [6] [7] . Most Internet users studied reported that they knew how to find health information, but their confidence in distinguishing high quality from low quality resources online was significantly lower [8] [9] . Even among students of health science, low levels of eHealth Literacy have been documented, with few knowing about free, credible health databases [10] .

The impact of misinformation online is at least twofold.

First, the mere presence of such information can influence Internet users’ search and browsing habits. For instance, confirmation biases, in which people tend to seek out information that confirms their preexisting beliefs [11] , have been observed to operate in online searches. In the presence of conflicting information on a health topic, individuals actively and preferentially access information that reinforces their beliefs while avoiding information that challenges their beliefs [12] . Similarly, research has shown that internet users’ search strategies are systematically biased towards examining only the top search results from search engines and following links related to more serious health conditions when trying to self diagnose [13] . Despite these biases, Internet users tend to believe the information they find online is accurate and trustworthy, regardless of the actual accuracy of the information [14] .

Second, health information has also been shown to actively shape various users’ health attitudes and behaviors [1] [15] [16] [17] [18] [19] . Research shows that online health information can influence when or if users contact health professionals [20] , participate in health screening programs [21] , engage in complementary and alternative medicine [22] , or adhere to physician recommendations [21] [23] [24] .

Previous research has examined the quality and accuracy of health information posted to professional, static websites [25] [26] and online supplement retailers [27] . While poor, incomplete, or misleading information is present on many of these websites, researchers have made efforts to address this through the development of tools for assessing the veracity of such pages’ content [28] and noted several characteristics of higher quality sources such as the presence of disclaimers, availability of references, and authorship disclosure [29] as well as the length of information and frequent external links [30] .

Ascertaining the veracity of webpages’ health information becomes more challenging on interactive websites where Internet users play a role in generating the web pages’ content. Whereas the overall quality and accuracy of a static website’s content, which is developed by a single person or single team, can often be assessed in a single pass, such assessments become more challenging with user- generated content, where high-quality health information can be presented alongside incomplete information, emotionally powerful personal anecdotes, misinformation attributable to users’ misperceptions, and even intentionally misleading misinformation.

While research has examined the overall quality of information on some interactive health-focused websites such as the message boards used in online support groups [31] , relatively little is known about less health-specific web sites, such as knowledge exchange social websites (KESWs). Knowledge Exchange Social Websites differ from support group message boards in that they are not explicitly focused on a single topic. Whereas support groups develop communities defined by a shared interest in a single, specific health condition, KESWs, which provide a forum for users to post questions on any topic anonymously and to respond to other users’ questions anonymously, attract a much broader, diverse audience of users.

Accurate and timely online information is particularly important during an outbreak of a (re)emerging infectious disease. Slow dissemination of information through official channels and confusing or conflicting messages in the media generate high levels of panic in the general public and drive them to seek answers on the internet [32] [33] [34] . The current study focuses on Ebola virus disease (EVD), as the response to the 2014 outbreak in West Africa was impacted by the presence of misinformation and highlighted the effects of such information on outbreak containment, support of proper quarantine procedures, and social stigmatization of patients [35] [36] . While the 2014 outbreak never made significant inroads into the United States, research has highlighted several characteristics of the US populace that could exacerbate the spread of an infectious disease during a global pandemic. Specifically, knowledge and utilization of official channels for government health communication remain low [36] . At the same time, in the case of Ebola, overall knowledge about the disease is low [36] [37] while generalized mistrust and conspiracy beliefs related to the medical industry [35] are prevalent. Under conditions in which Internet users are underutilizing official health communication channels, harboring mistrust towards the medical establishment, and carrying factual inaccuracies about a disease, KESWs, with their anonymity, pose a risk for fueling the spread of misinformation.

The present study seeks to address some of the knowledge gap on the accuracy of health information posted to KESWs by examining the types of Ebola questions being posted on a popular KESW and rating the accuracy of the anonymous users’ answers to these questions. In addition, the relationship between answer characteristics, such as inclusion of links to references, and answers’ accuracy was examined in order to determine whether answer characteristics could be used to identify higher quality answers.

2. Methods

2.1. Data Collection

The decision was made to focus the study on a single KESW. Of the KESWs reviewed, Yahoo Answers was selected due to the interface’s ease of searching and retrieving questions and answers as well as for its reach; in 2016 Yahoo was ranked as the third most popular multi-platform web property in the United States with 206 million unique visitors in a single month (https://www.statista.com/statistics/271412/most-visited-us-web-properties-based-on-number-of-visitors/).

On March 25, 2015, a total of 23 posts with the keyword “ebola” were extracted from Yahoo Answers for analysis (see Figure 1). Upon initial review 5 posts were excluded as they asked subjective questions whose answers could not be rated for accuracy (see Table 1’s excluded category for an example question),

Figure 1. Flow chart of question/answer inclusion and exclusion.

resulting in a dataset of 18 posts. Upon further review, several of the 18 posts contained multiple questions. Each question within the posts was examined independently, yielding a total of 35 distinct questions about Ebola. A total of 204 answers were offered to these 35 questions. Each question had between 2 to 11 answers offered, with the average number of answers posted per question being 5.83 (SD = 3.24).

In addition to questions and answers, six accompanying data points were extracted from each answer:

1) Best Answer: Since March 2014, the person who posted their question(s) on Yahoo Answers gets to mark one of the answers provided as the Best Answer. All sets of answers had a Best Answer marked.

2) Professional Background: This variable captured whether or not each answerer indicated that their answer was based on their professional background in the health sciences (ex: answerer indicated that they were a nurse with 10 years of experience with infectious diseases).

3) Statistical Information: This variable captured whether or not each answer included the use of statistics.

4) Source Disclosure: This variable captured whether or not each answer contained a disclosure that the information presented came from an external source, as it was discovered that many answers contained unmodified copied and pasted content from other websites.

5) Link: This variable captured whether the answer contained a link to an external website for additional information.

6) Word Count: A count of the words used in each answer.

2.2. Answer Accuracy

In order to evaluate the accuracy of each posted answer, answers were coded into one of five categories:

1) Accurate: Accurate answers contained no factual errors and addressed the question that was asked.

2) Inaccurate: Inaccurate answers contained one or more factual errors. Note that, given the severe consequences of misinformation on infectious diseases, it was decided to rate answers as inaccurate even if the answer contained accurate information as well as inaccurate information.

3) Subjective: Subjective answers included any response whose accuracy could not be rated, such as statements of opinion.

4) Unanswered: Unanswered answers represented responses that did not address the question that was asked.

5) Trolling: Upon working with the data, it became clear that a fifth category was needed in order to capture responses that not only didn’t answer the question asked, but which also took on the characteristics of online trolling, which Merriam-Webster defines as “to antagonize (others) online by deliberately posting inflammatory, irrelevant, or offensive comments or other disruptive content” (https://www.merriam-webster.com/dictionary/troll).

The accuracy of all answers was assessed independently by two of the authors. The authors then examined each other’s ratings and discussed the answers they disagreed upon. A physician was available as the tiebreaker in case the authors could not agree upon an answer’s accuracy rating after discussion, though all disagreements were resolved with discussion between the authors without need for the physician’s intervention.

3. Data Analysis

All data were analyzed with SPSS version 24.0 (IBM, 2016) [38] .

A thematic analysis was conducted in order to establish a codebook of the types of questions being asked about Ebola on Yahoo Answers [39] . In the first stage, two of the authors read through the entirety of the set of questions in order to familiarize themselves with the data. Following the read-through both readers independently developed a set of emergent themes to organize the types of questions asked. These emergent themes were then shared with the full research team who helped to reconcile differences in the two authors’ coding schemes and arrive at a final coding scheme.

Simple descriptive statistics (frequency and valid percent) and histograms were employed to examine the types of Ebola questions being asked, the accuracy of answers to these questions, and the role of answers voted “best answer” by the KESW user who posted each question.

Multiple logistic regression modeling was used to examine whether answer characteristics (best answer, professional background, statistical information, source disclosed, link, and word count) predict accuracy (re-coded to a dichotomous accurate vs. inaccurate). Answers that fundamentally failed to address the question asked (i.e. subjective, trolling, or unanswered) were excluded from the logistic regression model, as readers looking for an answer to a health question could reasonably be expected to disregard these answers. As there were no a priori predictions regarding which variables would emerge as significant predictors of answers’ accuracy, five of the six predictors were force entered into the final logistic regression model. The sixth predictor, professional background, was ultimately removed from the model, as only three answers came from respondents citing a professional background, which precluded meaningful analysis of this variable.

4 Results

4.1. Types of Ebola Questions Asked

A total of seven themes were identified during the thematic analysis of types of Ebola questions posted to Yahoo Answers. Table 1 presents each theme along with a representative example question drawn from the dataset.

The topics of Yahoo Answers visitors’ questions showed significant heterogeneity, with each of the question categories capturing only between 4.9% -

Table 1. Types of Ebola Questions Posted to a KESW (n = 209).

Figure 2. Frequency of question topics.

27.5% of the question totals (see Figure 2).

4.2. Accuracy of Ebola Answers

Overall, only 27.0% of the posted answers were rated as “accurate” (i.e. answering the question asked and containing no factual errors; see Figure 3). However, when accuracy was compared between answers to differing topics, substantial heterogeneity was observed, with between 11.8 - 45.5% of answers being rated as accurate (see Table 2). When Yahoo Answers’ “best answers” were examined, the overall accuracy was substantially higher, with 80.0% of “best answers” being rated as accurate compared to 16.0% of all other answers (see Figure 4).

4.3. Predictors of Answer Accuracy

Logistic regression modeling found that the overall model with all five predictors together served as a statistically significant predictor of answers’ accuracy (χ2(5) = 25.08, p < 0.001; Nagelkerke R2 = 0.37). Examining the individual predictors revealed only a single statistically significant predictor of accurate answers (see Table 3). Specifically, answers that were voted “best answer” were approximately 21 times as likely to be rated accurate (OR = 21.32, 95% CI = 1.47 - 310.02, p = 0.03).

Figure 3. Overall answer accuracy.

Table 2. Percent of Answers in Each Accuracy Category by Type of Question Asked (n = 204).

Figure 4. Answer accuracy by “Best Answer” status.

Table 3. Summary of Logistic Regression Analysis for Variables Predicting Answer Accuracy (n = 81).

5. Discussion

Overall, the accuracy of Ebola information posted to Yahoo Answers was quite low, with less than half of all answers providing fully accurate information. More troubling, the questions that would be most relevant during an infectious disease outbreak, namely transmission, symptoms, and treatment, were each answered accurately less than a third of the time. In light of Internet users’ low electronic health literacy [6] [7] , susceptibility to search biases [12] [14] [20] , and tendency to base health behaviors off of online information [1] [13] [15] - [21] [23] [24] , these data suggest that KESWs could serve as a source of misinformation and a driver of high risk behaviors during an infectious disease outbreak.

The finding that people who posted questions on the KESW later selected “best answers” that were 21 times more likely to be accurately answered helps to allay some of these concerns raised about visitors’ eHealth literacy. In aggregate, it seems like KESWs users were able, to some degree, to discern accurate information from the various responses given. In fact, 80.0% of the answers voted “best answer” were accurate while only 2.9% of these answers were categorically inaccurate. That said there remain significant unknowns. For instance, while the users who posted the questions in this sample tended to select accurate “best answers”, it is unclear whether and how the demography of question posters might differ from users who only passively read through others’ questions and answers. In addition, it is unclear to what degree users rely on the best answers or instead read through multiple answers, possibly looking for the answer that most closely matches their preexisting beliefs or perceptions.

In addition, the observation that nearly a quarter of the responses represented attempts to troll the question poster speaks to the communities utilizing KESWs. Unlike health forums and support groups established to address a single health problem, KESWs appear to draw a more diverse population of Internet users, including Internet trolls. Anecdotally, several of the most egregious, inflammatory statements were attributable to a small number of repeat offenders whose inflammatory comments appeared under several questions. At the same time, only three of the answers provided came from users who indicated a relevant professional background.

Several limitations should be considered when examining these results. First, in the absence of further data, it is worth noting that the culture of KESW users may differ widely from Website to Website, limiting the generalizability of these findings. Further research is needed to explore not only how KESW users differ across different sites such as Yahoo Answers versus Reddit, but also how the culture of users differs across different health topics. For instance, the participation of vociferous groups like the anti-vaxxer community could radically change the distribution of accurate to inaccurate posted answers on topics like childhood vaccination recommendations. Likewise, it seems plausible that trolling may be more prevalent in posts related to topics being popularized by the media. Media coverage of infectious disease outbreaks may serve to draw trolls to posts related to those diseases.

Another limitation of this study is the treatment of accuracy as a dichotomous variable. The coding of websites’ accuracy has varied from study to study, with some evaluating the proportion of content that is accurate rather treating the content as either accurate or inaccurate. In this study, content with any misinformation at all was coded inaccurate, not only because of the potential harmful impact of any misinformation during an infectious disease outbreak, but also because misinformation surrounded by accurate information may be particularly insidious and difficult to detect. That said, examination of the ratio of accurate to inaccurate information within each KESW answer might be illuminating.

In addition, due the high ratio of answers to questions, although 204 answers were available to code, only 23 posts with 35 total questions were examined. This raises the possibility that other types of questions are being asked about Ebola on KESWs, or that ratio of question topics being addressed may differ from those presented here. These data nonetheless take the first steps towards filling the knowledge gap on KESW answers’ accuracy, and future replication research will help to verify the types of questions being asked.

Ultimately, these data highlight the risks posed by seeking health information related to emerging infectious disease online through KESWs. Although those posting questions selected “best answers” that were often accurate, too little is known about the browsing habits of other KESW users. The presence of frequent misinformation among the posted responses and high volume of unhelpful information (unanswered, subjective, or trolling responses), suggest that these sites may pose special risks to users with low health literacy or medical misperceptions. In the context of Ebola, this misinformation could translate into challenges to outbreak containment, opposition to proper quarantine procedures, or social stigmatization of patients.

Further research is needed in order to explore the landscape of different KESWs and health topics, though these preliminary results raise concerns. If these patterns of inaccurate information hold true in other contexts, it may be necessary to provide users with tools to help them ascertain the veracity of user- generated claims, work directly with KESW providers to develop quality control mechanisms on their websites, and direct practitioners’ attention to these sites both to drive further research as well as to prepare practitioners to work with populations using these sites as a source of medical information.

Cite this paper

Gorman, F., Yadegarians, D., Islam, T., Tongco, S., Johnston, E., Estrada, E. and Gorman, N. (2017) Accuracy of Ebola Information in a Knowledge Exchange Social Website (KESW). Open Journal of Preventive Medicine, 7, 210-223. https://doi.org/10.4236/ojpm.2017.710017

References

  1. 1. Pew Research Center (PRC) (2006) Online Health Search 2006. http://www.pewinternet.org/pdfs/PIP_Online_Health_2006.pdf

  2. 2. Escoffery, C. (2017) Gender Similarities and Differences for e-Health Behaviors among US Adults. Telemedicine and e-Health.

  3. 3. Kanthawala, S., Vermeesch, A., Given, B. and Huh, J. (2016) Answers to Health Questions: Internet Search Results versus Online Health Community Responses. Journal of Medical Internet Research, 18, No. 4. https://doi.org/10.2196/jmir.5369

  4. 4. Azer, S.A., AlOlayan, T.I., AlGhamdi, M.A. and AlSanea, M.A. (2017) Inflammatory Bowel Disease: An Evaluation of Health Information on the Internet. World Journal of Gastroenterology, 23, 1676. https://doi.org/10.3748/wjg.v23.i9.1676

  5. 5. McGoldrick, D.M., Kielty, P. and Cotter, C. (2017) Quality of Information about Maxillofacial Trauma on the Internet. British Journal of Oral and Maxillofacial Surgery, 55, 141-144. https://doi.org/10.1016/j.bjoms.2016.09.020

  6. 6. Diviani, N., van den Putte, B., Giani, S. and van Weert, J.C. (2015) Low Health Literacy and Evaluation of Online Health Information: A Systematic Review of the Literature. Journal of Medical Internet Research, 17, No. 5. https://doi.org/10.2196/jmir.4018

  7. 7. Tennant, B., Stellefson, M., Dodd, V., Chaney, B., Chaney, D., Paige, S. and Alber, J. (2015) e-Health Literacy and Web 2.0 Health Information Seeking Behaviors among Baby Boomers and Older Adults. Journal of Medical Internet Research, 17, e70. https://doi.org/10.2196/jmir.3992

  8. 8. Knapp, C., Madden, V., Wang, H., Sloyer, P. and Shenkman, E. (2011) Internet Use and e-Health Literacy of Low-Income Parents Whose Children Have Special Health Care Needs. Journal of Medical Internet Research, 13, No. 3. https://doi.org/10.2196/jmir.1697

  9. 9. Park, H., Cormier, E., Gordon, G. and Baeg, J.H. (2016) Identifying Health Consumers’ e-Health Literacy to Decrease Disparities in Accessing e-Health Information. CIN: Computers, Informatics, Nursing, 34, 71-76.

  10. 10. Haruna, H., Tshuma, N. and Hu, X. (2017) Health Information Needs and Reliability of Sources among Nondegree Health Sciences Students: A Prerequisite for Designing e-Health Literacy. Annals of Global Health, 83, 369-379. https://doi.org/10.1016/j.aogh.2017.03.516

  11. 11. Nickerson, R. and Salovey, P. (1998) Confirmation Bias: A Ubiquitous Phenomenon in Many Guises. Review of General Psychology, 2, 175-220. https://doi.org/10.1037/1089-2680.2.2.175

  12. 12. Kayhan, V. (2013) Seeking Health Information on the Web: Positive Hypothesis Testing. International Journal of Medical Informatics, 82, 268-275.

  13. 13. Mueller, J., Jay, C., Harper, S. and Todd, C. (2017) The Role of Web-Based Health Information in Help-Seeking Behavior Prior to a Diagnosis of Lung Cancer: A Mixed-Methods Study. Journal of Medical Internet Research, 19, e189. https://doi.org/10.2196/jmir.6336

  14. 14. Morahan-Martin, J.M. (2004) How Internet Users Find, Evaluate, and Use Online Health Information: A Cross-Cultural Review. Cyber Psychology and Behavior, 7, 497-510. https://doi.org/10.1089/cpb.2004.7.497

  15. 15. Betsch, C., Renkewitz, F., Betsch, T. and Ulshöfer, C. (2010) The Influence of Vaccine-Critical Websites on Perceiving Vaccination Risks. Journal of Health Psychology, 15, 446-455. https://doi.org/10.1177/1359105309353647

  16. 16. Hesse, B.W., Nelson, D.E., Kreps, G.L., Croyle, R.T., Arora, N.K., Rimer, B.K. and Viswanath, K. (2005) Trust and Sources of Health Information: The Impact of the Internet and Its Implications for Health Care Providers: Findings from the First Health Information National Trends Survey. Archives of Internal Medicine, 165, 2618-2624. https://doi.org/10.1001/archinte.165.22.2618

  17. 17. Lau, A.Y. and Coiera, E.W. (2008) Impact of Web Searching and Social Feedback on Consumer Decision Making: A Prospective Online Experiment. Journal of Medical Internet Research, 10, e2. https://doi.org/10.2196/jmir.963

  18. 18. Liszka, H.A., Steyer, T.E. and Hueston, W.J. (2006) Virtual Medical Care: How Are Our Patients using Online Health Information? Journal of Community Health, 31, 368-378. https://doi.org/10.1007/s10900-006-9019-3

  19. 19. Sak, G., Diviani, N., Allam, A. and Schulz, P.J. (2016) Comparing the Quality of Pro- and Anti-Vaccination Online Information: A Content Analysis of Vaccination-Related Webpages. BMC Public Health, 16, 38. https://doi.org/10.1186/s12889-016-2722-9

  20. 20. Mueller, J., Jay, C., Harper, S., Davies, A., Vega, J. and Todd, C. (2017) Web Use for Symptom Appraisal of Physical Health Conditions: A Systematic Review. Journal of Medical Internet Research, 19, e202. https://doi.org/10.2196/jmir.6755

  21. 21. Cline, R.J. and Haynes, K.M. (2001) Consumer Health Information Seeking on the Internet: The State of the Art. Health Education Research, 16, 671-692. https://doi.org/10.1093/her/16.6.671

  22. 22. Holmes, M.M., Bishop, F.L. and Calman, L. (2017) “I Just Googled and Read Everything”: Exploring Breast Cancer Survivors’ Use of the Internet to Find Information on Complementary Medicine. Complementary Therapies in Medicine, 33, 78-84.

  23. 23. Ahmad, F., Hudak, P.L., Bercovitz, K., Hollenberg, E. and Levinson, W. (2006) Are Physicians Ready for Patients with Internet-Based Health Information? Journal of Medical Internet Research, 8, e22. https://doi.org/10.2196/jmir.8.3.e22

  24. 24. Smith, S.D., Farrugia, L.L., Harris, V., Lee, A., Blaszczynski, A. and Fischer, G. (2017) Evaluation of the Influence of Family and Friends, and the Internet on Patient Perceptions of Long-Term Topical Corticosteroid Use. Journal of Dermatological Treatment, 1-8. https://doi.org/10.1080/09546634.2017.1306017

  25. 25. Eysenbach, G., Powell, J., Kuss, O. and Sa, E.R. (2002) Empirical Studies Assessing the Quality of Health Information for Consumers on the World Wide Web: A Systematic Review. JAMA, 287, 2691-2700. https://doi.org/10.1001/jama.287.20.2691

  26. 26. Storino, A., Castillo-Angeles, M., Watkins, A.A., Vargas, C., Mancias, J.D., Bullock, A., Kent, T.S., et al. (2016) Assessing the Accuracy and Readability of Online Health Information for Patients with Pancreatic Cancer. JAMA Surgery, 151, 831-837. https://doi.org/10.1001/jamasurg.2016.0730

  27. 27. Tejedor-García, N., García-Pastor, C., Benito-Martínez, S. and de Lucio-Cazaña, F.J. (2017) Information Quality and Health Risks in Spanish-Language Retail Websites for Chinese Herbal Medicine. Gaceta Sanitaria.

  28. 28. Kim, P., Eng, T.R., Deering, M.J. and Maxfield, A. (1999) Published Criteria for Evaluating Health Related Web Sites. BMJ, 318, 647-649. https://doi.org/10.1136/bmj.318.7184.647

  29. 29. Wang, Y. and Liu, Z. (2007) Automatic Detecting Indicators for Quality of Health Information on the Web. International Journal of Medical Informatics, 76, 575-582.

  30. 30. Greenberg, L., D’Andrea, G. and Lorence, D. (2004) Setting the Public Agenda for Online Health Search: A White Paper and Action Agenda. Journal of Medical Internet Research, 6. https://doi.org/10.2196/jmir.6.2.e18

  31. 31. Esquivel, A., Meric-Bernstam, F. and Bernstam, E.V. (2006) Accuracy and Self Correction of Information Received from an Internet Breast Cancer List: Content Analysis. BMJ, 332, 939-942. https://doi.org/10.1136/bmj.38753.524201.7C

  32. 32. Fung, I.C.H., Tse, Z.T.H., Cheung, C.N., Miu, A.S. and Fu, K.W. (2014) Ebola and the Social Media. The Lancet, 384, 2207.

  33. 33. Gonsalves, G. and Staley, P. (2014) Panic, Paranoia, and Public Health—The AIDS Epidemic’s Lessons for Ebola. New England Journal of Medicine, 371, 2348-2349. https://doi.org/10.1056/NEJMp1413425

  34. 34. Towers, S., Afzal, S., Bernal, G., Bliss, N., Brown, S., Espinoza, B., Mamada, R., et al. (2015) Mass Media and the Contagion of Fear: The Case of Ebola in America. PLoS ONE, 10, e0129179. https://doi.org/10.1371/journal.pone.0129179

  35. 35. Earnshaw, V.A., Bogart, L.M., Klompas, M. and Katz, I.T. (2016) Medical Mistrust in the Context of Ebola: Implications for Intended Care-Seeking and Quarantine Policy Support in the United States. Journal of Health Psychology. https://doi.org/10.1177/1359105316650507

  36. 36. Koralek, T., Runnerstrom, M.G., Brown, B.J., Uchegbu, C. and Basta, T.B. (2016) Lessons from Ebola: Sources of Outbreak Information and the Associated Impact on UC Irvine and Ohio University College Students. PLoS Currents, 8. https://doi.org/10.1371/currents.outbreaks.f1f5c05c37a5ff8954f38646cfffc6a2

  37. 37. Highsmith, H.Y., Cruz, A.T., Guffey, D., Minard, C.G. and Starke, J.R. (2015) Ebola Knowledge and Attitudes among Pediatric Providers before the First Diagnosed Case in the United States. The Pediatric Infectious Disease Journal, 34, 901-903. https://doi.org/10.1097/INF.0000000000000755

  38. 38. IBM Corp (2016) IBM SPSS Statistics for Mac, Version 24.0. IBM Corp., Armonk.

  39. 39. Braun, V. and Clarke, V. (2006) Using Thematic Analysis in Psychology. Qualitative Research in Psychology, 3, 77-101. https://doi.org/10.1191/1478088706qp063oa