URBIM

urbim

Startups of The Year 2023 Winners: Europe

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Table 2. Percentage of vaccine-negative webpages in different SERPs Total of 30 webpages for each SERP. Cells are colour coded: median (20%), yellow; maximum (53%), red; minimum (0%), green. *Significantly different from Google.com by two-tailed Fisher’s test corrected for multiple comparison using the method of Benjamini, Krieger and Yekutieli at a false discovery rate of 5%. #significantly different from the localized version of Google.

Online Information of Vaccines: Table 2. Percentage of Vaccine-negative Webpages in Different SERPs

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Table 1. Example of classification of webpages Positive stance on vaccines https://www.historyofvaccines.org/content/articles/do-vaccines-cause-autism https://www.nhs.uk/news/medication/no-link-between-mmr-and-autism-major-study-finds/ https://www.nhs.uk/conditions/vaccinations/mmr-vaccine/ https://www.autism.org.uk/get-involved/media-centre/position-statements/mmr-vaccine.aspx https://kidshealth.org/en/parents/autism-studies.html https://vaccine-safety-training.org/mmr-vaccine-increases.html https://www.nejm.org/doi/full/10.1056/NEJMoa021134 https://www.ncbi.nlm.nih.gov/pubmed/30986133 https://www.ncbi.nlm.nih.gov/pubmed/15366972 Negative stance on vaccines https://www.thelancet.com/journals/lancet/article/PIIS0140673605756968/fulltext www.whale.to/vaccine/vaccine_autism_proven.html www.vaccineriskawareness.com/Infant-Vaccines-Produce-Autism-Symptoms-In-Primates https://leftbrainrightbrain.co.uk/2014/07/17/more-of-that-vaccineautism-research-that-doesnt-exist/ edition.cnn.com/2011/HEALTH/01/05/autism.vaccines/index.html https://www.coasttocoastam.com/show/2018/02/21 nocompulsoryvaccination.com/2014/08/22/vaccine-autism-cover-up/ https://www.newswars.com/vaccine-autism-questioned-by-doctor-congressman-elect/ vaxtruth.org/2011/08/vaccines-do-not-cause-autism/ Neutral stance on vaccines https://www.physicsforums.com/threads/vaccine-and-autism-link.880852/ www.discovermagazine.com/2009/jun/06-why-does-vaccine-autism-controversy-live-on https://www.ecso.org/news/autism-charity-founder-anti-vaccination-campaigner/ https://www.theguardian.com/society/2019/jun/01/professor-who-links-vaccines-to-autismfunded-through-university-portal https://www.independent.co.uk/news/world/americas/trump-vaccines-autism-links-anti-vaxxerus-president-false-vaccine-a8331836.html https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2376879/

Online Information of Vaccines: Table 1. Example of Classification of Webpages

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Corresponding author: Professor Pietro Ghezzi, Brighton and Sussex Medical School, Trafford Centre, University of Sussex, Falmer, Brighton, BN19RY, UK. Email: p.ghezzi@bsms.ac.uk; phone: +44-(0)1273-873112 Abstract The fact that Internet companies may record our personal data and track our online behaviour for commercial or political purpose has emphasized aspects related to online privacy. This has also led to the development of search engines that promise no tracking and privacy. Search engines also have a major role in spreading low-quality health information such as that of anti-vaccine websites. This study investigates the relationship between search engines’ approach to privacy and the scientific quality of the information they return. We analyzed the first 30 webpages returned searching “vaccines autism” in English, Spanish, Italian and French. The results show that “alternative” search engines (Duckduckgo, Ecosia, Qwant, Swisscows and Mojeek) may return more anti-vaccine pages (10-53%) than Google.com (0%). Some localized versions of Google, however, returned more anti-vaccine webpages (up to 10%) than Google.com. Our study suggests that designing a search engine that is privacy savvy and avoids issues with filter bubbles that can result from user-tracking is necessary but insufficient; instead mechanisms should be developed to test search engines from the perspective of information quality (particularly for health-related webpages), before they can be deemed trustworthy providers of public health information. Introduction The World Health Organization lists vaccine hesitancy as one of the top ten threats to global health in 2019 1, requiring ongoing global monitoring. Despite the fact that the 1998 study which incorrectly suggested that the MMR vaccine could cause autism in children and prompted antivaccine beliefs 2 has now been discredited, misinformation, and indeed, disinformation, about vaccines continues to be published on the Internet perpetuating such beliefs. It has been suggested that this misinformation plays a role in the current low uptake of vaccines in developed countries 3. Understanding whether this is actually the case, and how to address this issue, is crucial as web-based sources of health information may be instrumental to solve the sustainability challenge currently facing health systems across the globe. The accuracy of information provided by a website is a key indicator of its overall information quality (IQ). The broader aspects of IQ have been the subject of many studies 5, but health IQ and trustworthiness of the sources have only partially been characterized 6. Studies looking at the influence of variations in eHealth literacy levels 7 and trust in different sources of online health information2 indicate that the relationship is not linear in all cases, i.e. higher health IQ does not result automatically in higher perceived levels of trustworthiness. For example, in a study by Chen et al. 8, 618 people were recruited to complete a survey which tested their eHealth literacy level, asked them to identify which of 25 sources of health information they used, and how much they trusted each source. The study showed that people with lower eHealth literacy were less likely to trust medical websites (typically higher IQ) and more likely to trust social media, blogs, and celebrity webpages (typically lower IQ). This might seem a spurious result, were it not for the fact that research has shown that those with high eHealth literacy assess more accurately the credibility and relevance of online health information, whereas those with low eHealth literacy often struggle to locate and understand eHealth information 9. This difficulty lowers their self-efficacy 10, distorts their perception of source credibility, and impacts negatively perceived trustworthiness 9, ultimately creating a need for individuals with low eHealth literacy to find an alternative means of determining trustworthiness in online sources of information. One such alternative is social endorsement. Visible social endorsement, e.g. ‘likes,’ 11 enables those with low eHealth literacy to determine trust based on the bandwagon heuristic and assume that, if the source has already been deemed valid by others, then it is safe for them to trust it too 10,12. Traditional medical websites afford those with low eHealth literacy no such alternative means of determining credibility and trust. This suggests that those who are more vulnerable to the real-world effects of both disinformation and misinformation (e.g. declining to vaccinate their children) are more likely to rely on online sources with lower health IQ, which are more prone to spread such inflammatory and inaccurate information. Personalisation of online search results may favour this phenomenon and lead to a vicious cycle where the more one searches and reads dis- and mis-information about vaccines the less one finds and reads scientific information on the same topic. At the same time, there are increasing concerns about the privacy risks associated with Internet search engines storing potentially sensitive and private health information contained within users search histories, combining it with additional information collected for tracking purposes, and using these data for commercial or other purposes 13,14. This creates a public push back against the idea that search engines or public health providers should interfere in the results people see when searching for health information online. This makes it hard to address concerns about health disinformation/misinformation in a way that is at least socially acceptable if not ideally preferable 15. The UK’s National Health Service (NHS) discovered this when its announcement of Amazon Alexa responding with guaranteed high-IQ content from NHS.UK to user voice queries such as “Alexa, how do I treat a migraine,” resulted in a public outcry over privacy infringement 16. This raises the question whether, in the context of online vaccination information, it is possible at all to balance concerns about user privacy and IQ. The following pages seek to lay the foundations for answering this question by reporting on the methodology for, and results of, a study concerning the following research question: “What is the current relationship between search engines’ approach to privacy and the scientific quality of the information they return?”.

Online Information of Vaccines: Abstract and Introduction

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Conclusion Our analysis shows that while it may well be technically possible to design a search engine that manages to balance privacy-preservation with the promotion of high IQ material, this is currently not the case. The current relationship between privacy-preserving design features of search engines and the IQ of the results they return is inverse (although not proportionally). In instances where this can have a negative impact on public health, as in the example we have provided of the promotion of anti-vaccine misinformation, not intervening to alter the design of the algorithm even if this means sacrificing some degree of user privacy - can lead to severe harm for a large population of user and is, therefore, unethical. Designing a search engine that is privacy savvy and avoids issues with filter bubbles that can result from user-tracking may be a good thing, like designing a car with an engine that does not pollute and is inexpensive to run, and designers should seek to balance the different aspects of search engine design highlighted in Figure 3. However, if the brakes in an environmentally-designed car do not work, the car is unsafe and this negates the positive ethical decisions made by the designers. In a car this is a highly unlikely design outcome, as a car has to undergo several rounds of testing by regulatory agencies before being allowed on the market. This is not yet the case for search engines, which are only regulated from the perspective of data protection – which is primarily interpreted as data security rather than data privacy. Our study suggests that this is necessary but insufficient, and instead mechanisms should be developed to test search engines from the perspective of IQ, (particularly for YMYL webpages) before they can be deemed trustworthy providers of public health information. References 1. World Health Organization. Ten threats to global health in 2019. 2019. https://www.who.int/emergencies/ten-threats-to-global-health-in-2019 (archived at https://web.archive.org/web/20190627111040/https://www.who.int/emergencies/ten-threats-toglobal-health-in-2019) (accessed 27/06/2019 2. Wakefield AJ, Murch SH, Anthony A, et al. Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children. Lancet 1998; 351(9103): 637-41. 3. Stahl JP, Cohen R, Denis F, et al. The impact of the web and social networks on vaccination. New challenges and opportunities offered to fight against vaccine hesitancy. Med Mal Infect 2016; 46(3): 117-22. 4. Martin GP, Sutton E, Willars J, Dixon-Woods M. Frameworks for change in healthcare organisations: a formative evaluation of the NHS Change Model. Health Serv Manage Res 2013; 26(2-3): 65-75. 5. Illari P, Floridi L. Information quality, data and philosophy. The Philosophy of Information Quality: Springer; 2014: 5-23. 6. Al-Jefri M, Evans R, Uchyigit G, Ghezzi P. What is health information quality? Ethical dimension and perception by users. Frontiers in medicine 2018; 5. 7. Norman CD, Skinner HA. eHEALS: The eHealth Literacy Scale. J Med Internet Res 2006; 8(4): e27. 8. Chen X, Hay JL, Waters EA, et al. Health Literacy and Use and Trust in Health Information. J Health Commun 2018; 23(8): 724-34. 9. Paige SR, Krieger JL, Stellefson ML. The Influence of eHealth Literacy on Perceived Trust in Online Health Communication Channels and Sources. J Health Commun 2017; 22(1): 53-65. 10. Kim J, Park HA. Development of a health information technology acceptance model using consumers' health behavior intention. J Med Internet Res 2012; 14(5): e133. 11. Borah P, Xiao X. The Importance of 'Likes': The Interplay of Message Framing, Source, and Social Endorsement on Credibility Perceptions of Health Information on Facebook. J Health Commun 2018; 23(4): 399-411. 12. Huo C, Zhang M, Ma F. Factors influencing people’s health knowledge adoption in social media: the mediating effect of trust and the moderating effect of health threat. Library Hi Tech 2018; 36(1): 129-51. 13. Chiou L, Tucker C. Search engines and data retention: Implications for privacy and antitrust: National Bureau of Economic Research, 2017. 14. Esteve A. The business of personal data: Google, Facebook, and privacy issues in the EU and the USA. International Data Privacy Law 2017; 7(1): 36-47. 15. Floridi L, Taddeo M. What is data ethics? : The Royal Society; 2016. 16. Moskvitch K. Amazon’s Alexa deal with the NHS can help patients but at what cost? Wired, 2019. (accessed 8/11/2019). 17. Arif N, Al-Jefri M, Bizzi IH, et al. Fake News or Weak Science? Visibility and Characterization of Antivaccine Webpages Returned by Google in Different Languages and Countries. Front Immunol 2018; 9: 1215. 18. Maki A, Evans R, Ghezzi P. Bad news. Analysis of the quality of information on influenza prevention returned by Google in English and Italian. Frontiers in Immunology 2015; 6:616. doi: 10.3389/fimmu.2015.00616. 19. Fleiss JL, Levin B, Paik MC. Statistical methods for rates and proportions. Hoboken, NJ, USA: John Wiley & Sons; 2013. 20. Economist T. Seek and you shall find. Google rewards reputable reporting, not left-wing politics. The Economist 2019; 431(9146): 85. 21. Taddeo M, Floridi L. The Debate on the Moral Responsibilities of Online Service Providers. Science and engineering ethics 2015: 1-29. 22. Mittelstadt BD, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: Mapping the debate. Big Data & Society 2016; 3(2): 2053951716679679. 23. Association for Computing Machinery. ACM Code of Ethics and Professional Conduct. 2018. https://www.acm.org/code-of-ethics (archived at https://web.archive.org/web/20190627114921/https://www.acm.org/code-of-ethics) (accessed 27/06/2019 2019). 24. Tufekci Z. Algorithmic harms beyond Facebook and Google: Emergent challenges of computational agency. Colo Tech LJ 2015; 13: 203. 25. Hasnas J. Teaching business ethics: The principles approach. Journal of Business Ethics Education 2013; 10: 275-304. 26. Macdonald C, Gavura S. Alternative Medicine and the Ethics Of Commerce. Bioethics 2016; 30(2): 77-84. 27. Taddeo M, Floridi L. The Debate on the Moral Responsibilities of Online Service Providers. Sci Eng Ethics 2016; 22(6): 1575-603. 28. Chigwedere P, Seage GR, 3rd, Gruskin S, Lee TH, Essex M. Estimating the lost benefits of antiretroviral drug use in South Africa. J Acquir Immune Defic Syndr 2008; 49(4): 410-5. 29. Ouyang Y. Student's death highlights gaps in China's health regulations. Lancet Oncol 2016; 17(6): 709. 30. Browne M, Thomson P, Rockloff MJ, Pennycook G. Going against the Herd: Psychological and Cultural Factors Underlying the 'Vaccination Confidence Gap'. PLoS One 2015; 10(9): e0132562. 31. Bean SJ. Emerging and continuing trends in vaccine opposition website content. Vaccine 2011; 29(10): 1874-80.

Online Information of Vaccines: Conclusion and References

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Discussion The aim of this research was to investigate whether search engines focused on privacy preservation ranked webpages with higher and/or lower levels of IQ (interpreted as EBM based content i.e. vaccine-positive rather than vaccine-negative) differently to the primary commercial search engines. In turn, this answered the research question “What is the current relationship between search engines’ approach to privacy and the scientific quality of the information they return?”. The results indicate that currently privacy-enhancing search engines often give more visibility to webpages promoting vaccine hesitancy or with a clear anti-vaccine position than Google. This is in agreement with the findings from a recent study by the Economist which analyzed 175,000 news links returned by Google to demonstrate that the search engine’s algorithm favorstrustworthy publications 20. Reputation and trustworthiness are key factors included in Google’s ranking algorithm. In 2019, Google published search quality evaluation guidelines, 4 which define webpages containing information that may affect the users’ health or financial stability, as “your money your life” (YMYL) pages. These guidelines reveal that when rating YMYL webpages, Google looks at the three criteria of Expertise-Authority-Trustworthiness (EA-T) and states “High E-A-T information pages on scientific topics should be produced by people or organizations with appropriate scientific expertise and represent well-established scientific consensus on issues where such consensus exists”. Thus, in the case of Google, the bandwagon heuristic mechanism of assessing medical information credibility is working in favour of promoting IQ. This is perhaps because those responsible for driving up the ‘reputation’ of specific websites by, for example, linking to them, have higher levels of eHealth literacy and therefore act as pseudo-gatekeepers protecting those with lower eHealth literacy from poor IQ results by ensuring that websites providing inaccurate online health information have a low ranking in the search results. In the case of privacy-preserving engines this appears not to be working – potentially because they do not track ‘reputation’ factors, which could be seen as proxies for IQ and credibility, e.g. clicks and bounce-rate, and so have no gatekeepers (pseudo or otherwise) working to limit the circulation of misinformation. To our knowledge, the algorithms used by these ‘alternative’ search engines are not public - Qwant states that they use their own algorithms5 - but despite this, we found a large overlap between the SERP of Qwant and those of Bing and Ecosia. Likewise, Ecosia and Swisscows showed a similar overlap (70%) with Bing. This means that it is not possible to check what factors determine the outcome of the decision making processes of the search engines algorithms, and hence identify those elements that contribute to circulate misinformation. Even without being able to check the exact mechanisms for the overall poorer results, the results suggest that, currently, decisions made by search engines to prioritize privacypreservation may have a negative impact on the IQ of results returned to users in health contexts. The pledge to provide independent and unbiased results or not to promote or hide websites based on political or moral interests can be seen as ethically ambiguous, in view of the potential consequences of pointing to scientifically unsound health information. Medical ethics requires that patients give informed consent before treatment and must, therefore, be informed accurately of the risks and benefits associated with treatment, something that is not possible if the search engine provider used by an individual is returning results with low IQ. From this consequentialist perspective, it is inherently unethical choosing not to interfere with a search engine’s ranking algorithm to ensure ‘manually’ that results of higher IQ are prioritized, whilst those of lower IQ are suppressed. This builds on arguments already made in the wider literature about algorithm ethics 21,22. For example, the Association for Computing Machinery (ACM) code of ethics and professional conduct includes, as a general principle, “avoid harm” along with that of “respect privacy” 23, which aligns with the Hippocratic oath. Specifically, the implication that the current design of privacy-preserving search engine algorithms underestimates the need for evaluation of IQ fits into the wider discussion about algorithmic design and how to ensure design decisions are made to protect and incorporate key values such as IQ. It is necessary, but insufficient, to design search engine algorithms that index purely on ‘relevance’, they must also be designed to index on quality. The challenge lies in the ability to do this in a way that balances the need to accept different perspectives (particularly those that are rooted in different cultural, religious or social ideals) whilst also filtering for IQ. Supporters of such arguments, including the authors, note that this requirement necessitates making the workings of search engine algorithms more transparent 24 to ensure their ethical compliance. Providing information on vaccines that is based on misinformation or disinformation (including studies whose data or conclusions have been shown to be wrong) is a deceptive practice, which goes against the basic tenets of medical and business ethics 25. This is in line with those who argue that the promotion of ‘alternative medicine’ is unethical because it lacks evidence and transparency of clinical efficacy and should be considered ‘false advertising’ 26. Online service providers have a moral responsibilities to ensure that users access health information that is scientifically validate 27. Misinformation and disinformation concerning healthcare circulating on the internet can have severe consequences and lead to widespread harm. Consider the example of South African president Mbeki, who delayed introducing anti-retroviral drugs in favor of alternative medicine based on information obtained from HIV-denialist internet websites, a decision estimated to have resulted in over 300,000 deaths 28. More recently, a cancer patient died in China after following an alternative, non-approved therapy they found using a search engine 29. In response Chinese authorities issued new rules that require search engines to provide “objective, fair and authoritative results”. Moral responsibility follows on the level of harm that misinformation and disinformation on healthcare may cause. It could be argued that there is a greater onus on Google – and other commercial search engine providers – than on alternative search engines to take these considerations into account when designing or interfering with algorithms for the purposes of promoting ethical compliance, given their larger market share. Google currently has over 90% of the worldwide market share6 and therefore has the potential to indirectly ‘cause harm’, through the potential promotion of low IQ webpages on vaccinations, to a great many more people than any of the alternative providers. However, studies have shown that those who hold anti-authoritarian views, openness to (potentially) controversial opinions, and an interest in alternative medicine are, in some cases, already more likely to hold vaccine-hesitant beliefs 30. These are also the individuals who are most likely to use alternative search providers given their sensitivity to privacy and tracking concerns. Therefore, while the alternative providers might reach a proportionally smaller audience – they are reaching an audience that is already more receptive to antivaccine information 31, and therefore more vulnerable to its effects. In other words, unless the alternative providers take steps to rank vaccine-related search results according to IQ, they may cause greater harm to those they do reach, meaning that the net negative impact is still greater even though the number of individuals they reach is smaller.

Online Information of Vaccines: Discussion

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Web search and content analysis Searches in English were done from Falmer, Sussex, United Kingdom; in Italian from Urbino, Italy; in French from Bruxelles, Belgium; in Spanish from Barcelona, Spain. Each search was done using a logged-out Chrome browser cleared of cookies and previous search history so that the only identification was the IP address and its geolocalization. Additionally, when available, the local version of each search engine was used (e.g. Google.co.uk and Google.it). For searching Google.com, automatic redirection to google.co.uk was avoided by using the URL Google.com/ncr (no-country-redirect). The first 30 URL results from each search engine result page (SERP), excluding those marked as advertisements, and were transferred to a spreadsheet. When a duplicate URL was encountered, it was excluded. Websites were then visited and the content of each page was coded as vaccine-positive, negative or neutral, depending on the stance taken on the connection between vaccines and autism. Webpages recommending vaccination and/or negating the link with autism were coded as “vaccine-positive”. Those promoting vaccine hesitancy, cautioning about the risk of autism or openly anti-vaccine, were coded as “vaccine-negative”. Additionally, webpages that claimed further studies needed to be conducted to clarify the link between vaccines and autism were also coded as “vaccine-negative”, as previous research by {Browne, 2015 #421} has shown that users perceive this as confirmation of the fact that vaccine safety has not been proven. Webpages simply reporting the history of the anti-vaccine movement or a related legal debate were coded as “vaccine-neutral”. Examples of positive, negative and neutral webpages are provided in Table 1. Coding was completed by two raters for each language and inter-rater agreement was calculated with GraphPad, which uses equations 18.16 to 18.20 from Fleiss 19. On a sample of 59 webpages in English, agreement was 85%, with a Kappa of 0.669 (standard error, 0.077) and a 95% confidence interval from 0.518 to 0.820, a strength of agreement is considered to be 'good' 19. In Italian, agreement was 90%, with a Kappa of 0.818 (standard error, 0.067) and a 95% confidence interval from 0.687 to 0.950, a strength of agreement is considered to be 'very good'. In Spanish, agreement was 83%, with a Kappa of 0.609 (standard error, 0.098) and a 95% confidence interval from 0.418 to 0.801, a strength of agreement is considered to be 'very good'. In French, agreement was 89% with a Kappa of 0.746 (standard error, 0.091) and a 95% confidence interval from 0.568 to 0.924. When frequencies of vaccine-negative webpages was compared across different search engines, we used a two-tailed Fisher’s test corrected for multiple comparison using the method of Benjamini, Krieger and Yekutieli and a false discovery rate (FDR) of 5%.

Online Information of Vaccines: Web Search and Content Analysis

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Results Figure 1 shows the ranking of positive (green), neutral (yellow), and negative (red) websites returned by the different search engines in English, French, Italian and Spanish. A comparison of the percentage of vaccine-negative webpages in different SERPs (Table 2) shows that Google is consistently returning less misinformation, although some of its local version show more vaccine-negative webpages than the English-US version (Google.com). Other search engines return some vaccine-negative webpages with some, like Mojeek in English-UK and Arianna and Virgilio in Italian are the most likely to rank higher webpages with misinformation. In English, the frequency of vaccine-negative webpages in Yahoo, Bing and Mojeek was significantly higher than in Google.com. In Italian, all SERPs had a significantly higher proportion of vaccine-negative webpages compared with Google.com. In French, all search engines returned a significantly higher number of vaccine-negative webpages than Google.com or the local version Google.fr. There were no significant differences for search engines in Spanish. The SERPs of all search engines providers contained a higher proportion of vaccine-negative results than those obtained from Google.com. Even the localized versions of Google (Google.co.uk, Google.it and Google.es) returned more negative pages than the US/international English Google.com. The two Italian-only search engines (Virgilio and Arianna) returned the highest number of negative pages in Italian. In several instances, the same webpages were returned by different search engines, with large overlaps between these results as shown in Figure 2.

Online Information of Vaccines: Results

This paper is available on arxiv under CC 4.0 license. Authors: (1) Pietro Ghezzi, Brighton & Sussex Medical School, Falmer, Brighton, UK; (2) Peter G Bannister, Brighton & Sussex Medical School, Falmer, Brighton, UK; (3) Gonzalo Casino, Communication Department, Pompeu Fabra University, Barcelona, Spain and Iberoamerican Cochrane Center, Barcelona, Spain; (4) Alessia Catalani, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (5) Michel Goldman, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (6) Jessica Morley, Oxford Internet Institute, University of Oxford, Oxford, UK; (7) Marie Neunez, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles; (8) Andreu Prados, Communication Department, Pompeu Fabra University, Barcelona, Spain, Iberoamerican Cochrane Center, Barcelona, Spain, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy, Institute for Interdisciplinary Innovation in healthcare (I3h), Université libre de Bruxelles, Oxford Internet Institute, University of Oxford, Oxford, UK, and Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain; (9) Mariarosaria Taddeo, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK; (10) Tania Vanzolini, Department of Biomolecular Sciences, University of Urbino Carlo Bo, Urbino, PU, Italy; (11) Luciano Floridi, Oxford Internet Institute, University of Oxford, Oxford, UK, Blanquerna School of Health Sciences, Universitat Ramon Llull, Barcelona, Spain, and The Alan Turing Institute, London, UK. Table of Links Abstract and Introduction Methods Web search and content analysis Results Discussion Conclusion and References Table 1. Example of classification of webpages Table 2. Percentage of vaccine-negative webpages in different SERPs Methods In seeking to answer the above research question, this study builds on previous work which: (a) focuses on the results returned by a search of “vaccines autism” in different countries and languages, and found a great variability in the composition of the webpages returned and their ranking 17; and (b) suggests that whether a webpage promotes a medical treatment based on the practices of evidence-based medicine (EBM; e.g. based on the reporting by Cochrane reviews) can act as a proxy for health IQ. The phrase “vaccines autism” was searched using the main search engines (Google, Bing and Yahoo) and alternative providers which focus on respecting privacy and personal data (Duckduckgo, Mojeek, Qwant and Ecosia3) in four languages/countries (English-UK, Italian, Spanish and French) and the international, US-English version of Google (Google.com). We also used some country- or language-specific search engines. Each webpage returned was classified as vaccine-positive, -negative or –neutral as described in the Table 1

Online Information of Vaccines: Methods

Scientific American, Volume XXXVI., No. 8, February 24, 1877 by Various, is part of the HackerNoon Books Series. You can jump to any chapter in this book . The Lost Arts in New York here THE LOST ARTS IN NEW YORK. While the objects of ancient art contained in the Castellani collection, recently placed on exhibition in the Metropolitan Museum of Art in this city, are individually of great rarity and archæological value, they derive additional importance from the fact that, viewed conjunctively as a collection, they represent connected histories of two great industrial arts extending over many centuries. Both in the work of the goldsmith and of the potter, we are enabled to trace progress from the earliest stages up to a period when the greatest skill was attained, and even subsequently into the era of decadence. In both industries, we find that ancient and mediæval workmen possessed knowledge which we do not possess; and among Signor Castellani's treasures may be seen handiwork which is the embodiment of two lost arts, the secrets of which the modern world, with all its infinitely superior wisdom, has not yet rediscovered. The productions, in the Castellani collection, of precious metal workers dating from prehistoric epochs, the exact dates of which are wholly unknown, and covering the long period ending in the thirteenth century, are represented by the contents of some twenty cases. The first three of these receptacles bear no dates. The ornaments which they contain are of bronze, amber, silver, and glass (the latter having become converted into opalescent silicic acid), and were found in Præneste (modern Palestrina, Italy), and in the territory which was ancient Etruria. Case No. 4 bears date 700 B.C., and here is a rich treasure of primitive Etruscan and Phœnician ornaments of gold, adorned with granulated work. Signor Castellani considers that the workmanship of these objects is so perfect that it is impossible at the present time to explain the process of execution, and very difficult to imitate it. The ornaments are of two kinds—those for ordinary use and those for funereal purposes. The first are massive, and might be worn for years without injury; the others are extremely delicate. All are made of the purest gold, and their decoration evinces the most consummate skill and taste on the part of the artist. There is, for example, a small flask, shaped something like an antique wine jar, and about five inches in height. It is of beaten gold, and is covered with a pattern intended to imitate the similarly shaped designs of variegated glass of the Græco-Phœnician period. This pattern is entirely produced by minute globules of metal soldered to the surface in tiers of zigzag or Vandyke patterns. Another specimen is a strip of gold covered with granulated lines and bearing a row of birds in relief. On other ornaments are exquisitely carved heads and flowers, produced apparently by hammering on the reverse of the object, but with a delicacy and precision of touch which is simply marvelous. The closest students of this ancient handiwork are entirely at a loss to understand how the processes of melting, soldering, and wire drawing, which were employed in the art, were performed. Modern workmen have failed in their attempts exactly to imitate the old ornaments; and it is certain that the secret of the mechanical agents, whereby it was possible to separate and join pieces of gold hardly perceptible to the naked eye, is lost. Signor Castellani has taken great pains to solve the problem, reading all the treatises of mediæval goldsmiths, inquiring of all classes of Italian jewelers, and experimenting with all kinds of chemicals, in the hope of finding the solder wherewith the minute grains were attached to the surface of the metal. At last he found some of the old processes still employed in a remote district, hidden in the recesses of the Apennines, far from the great towns. Bringing away a few workmen, he gave them much more instruction, and at last succeeded, not perhaps in equalling, but certainly in rivalling the ancient productions. We question whether the Etruscans used fire at all in their soldering, as it would be almost an impossibility to keep the excessively fine tools necessary for the work at a proper heat. Mr. Joshua Rose offers the plausible suggestion that a cold flux was employed, with which the workman followed the lines or dots of his pattern. Then the gold granules were possibly sprinkled over the surface, and adhered only to the solder, the superfluous grains being brushed off after the solder had set. There is also a fragment of a finely woven fabric, made of threads of pure gold, found on the body of a woman in a tomb at Metapontum. This is without doubt the material to which the Psalmist refers in speaking of "the King's daughter" having "clothing of wrought gold;" and in the Pentateuch there is reference to gold threads being used upon looms. As we follow the various objects in the twenty cases above mentioned, the decline of the goldworker's art when the use of enamels came into vogue is evidenced. Continuing on to later periods, the decadence is more marked under the successors of Alexander. In Rome, under the emperors, we find gold used as a mere setting for precious stones, and finally the collection terminates with examples of workmanship of the time of Charlemagne, when the workmen had lost their cunning, and the noble metal had been altogether debased to secondary uses. The second instance where a lost art is exemplified in Signor Castellani's collection is in the glazing of the Gubbio majolica. We have not space here to review the magnificent series of ancient specimens of pottery in detail; and thus it will suffice to say that, beginning with some of the earliest pieces made by the Arabs when they occupied Sicily, from the twelfth to the sixteenth century, the collection presents examples of all the finest types of later mediæval art. Gubbio, where the peculiar kind of majolica above noted was made, is a small town once in the territory of the dukes of Urbino; and in the sixteenth century it became famous for its pottery. This was attributable to the talent of one man, Giorgio Andreoli, who is reputed to have invented the wonderful luster characteristic of the Gubbio ware. The body of majolica is mere common clay; and after the piece is finished on the wheel, it is dried and burnt in a furnace. After the biscuit thus prepared has been dipped in the glaze, the colors are applied on the soft surface of the latter, and the vitrifying process fuses all into a glossy enamel of the color of the pigment. This is still the common practice; and we mention it merely to show that to his pigment and glaze Andreoli must have added some third substance, which rendered the enamel capable of reflecting white light as blue, red, green, or yellow light—in other words, of giving the object a luster of a color wholly different from the tints of the pigment. He evidently could produce any desired color at will, and the effects gained are indescribably beautiful. The Castellani collection contains 130 superb specimens, which glow like jewels. In one, the scene of the nativity of Christ is provided with the figures in low relief, and the exquisite cerulean lustre is imparted to give the effect of moonlight. The rarest pieces are those of which the luster is a delicate green. Some blaze with yellow, as if of gold; others exhibit the brilliancy of the ruby; while others resemble the interior of the pearl oyster shell. Whether this sheen is produced by polarization of the light in some manner, or whether it is at all analogous to fluorescence, is yet to be decided. The impression of the surface with fine microscopic lines might produce an iridescence, but not separate and clearly defined hues. The ware was intended for ornamental purposes, not for household use; and it was suspended against the rich, dark tapestries of the period with which walls were covered, thus aiding, as it were, in illuminating the apartment with its exquisite radiance. About HackerNoon Book Series: We bring you the most important technical, scientific, and insightful public domain books. This book is part of the public domain. Various (2006). Scientific American, Volume XXXVI., No. 8, February 24, 1877. Urbana, Illinois: Project Gutenberg. Retrieved https://www.gutenberg.org/cache/epub/19406/pg19406-images.html This eBook is for the use of anyone anywhere at no cost and with almost no restrictions whatsoever. You may copy it, give it away or re-use it under the terms of the Project Gutenberg License included with this eBook or online at , located at www.gutenberg.org https://www.gutenberg.org/policy/license.html

Stories, News & Mentions about URBIM

Urbim’s Stories on HackerNoon