Table of Links Abstract and Introduction
Related Work
Feedback Mechanisms
The NewsUnfold Platform
Results
Discussion
Conclusion
Acknowledgments and References Abstract and Introduction Abstract and Introduction Related Work Related Work Feedback Mechanisms Feedback Mechanisms The NewsUnfold Platform The NewsUnfold Platform Results Results Discussion Discussion Conclusion Conclusion Acknowledgments and References Acknowledgments and References A. Feedback Mechanism Study Texts A. Feedback Mechanism Study Texts B. Detailed UX Survey Results for NewsUnfold B. Detailed UX Survey Results for NewsUnfold C. Material Bias and Demographics of Feedback Mechanism Study C. Material Bias and Demographics of Feedback Mechanism Study D. Additional Screenshots D. Additional Screenshots A Feedback Mechanism Study Texts Data Processing Agreement Data Processing Agreement Who are we and how do we use the data we collect from you through this survey? This research study is being con- ducted by the Media Bias Research Group. We are a group of researchers from various disciplines with the goal of developing systems and data sets to uncover media bias or unbalanced coverage in articles. This study is anonymous. That means that we will not record any information about you that could identify you personally or be associated with you. On the basis of the collected data, we aim to publish scientific papers on presentations of articles that help to detect biased language, but these publications do not allow any inference to you as an individual. Once the study is published, the anonymized data might be made available in a public data repository. Your rights to access, change, or move your information are limited insofar as the data may no longer be modified after the data has been published in anonymized form. The reason for this is that we need to manage your in- formation in specific ways for the research to be reliable and accurate. Once anonymized, we will not be able to delete your data. The study itself is not hosted on Prolific, but on a dedicated external server. Once the survey is complete, you will be shown a unique code that you can enter in the Prolific form. Participation in this study is voluntary. You may choose not to participate and you may withdraw at any time during the study without any penalty to you. If you have any questions about the study or study procedures, you may contact the Media Bias Research Group, info@media-bias-research.org Who are we and how do we use the data we collect from you through this survey? •   I agree to the processing of my personal data in accordance with the information provided herein.(Checkbox) Demographic Survey Demographic Survey What gender do you identify with? (Female, Male, Other, Prefer not to say)


What is your age? (Input field for number)


What is the highest level of education you have completed? (8th grade, Some high school, High school graduate, Vocational or technical school, Some college, Associate degree, Bachelor’s degree, Graduate work, Ph.D., I prefer not to say)


What is the level of your English proficiency? (Proficient, Independent, Basic)


Do you consider yourself to be liberal, conservative, or somewhere in between? Please slide to record your response. (Very liberal to Very conservative, -10 to 10 point slider)


How often on average do you check the news? (Never, Very rarely, Several times per month, Several times per week, Every day, Several times per day) What gender do you identify with? (Female, Male, Other, Prefer not to say) What gender do you identify with? (Female, Male, Other, Prefer not to say) What is your age? (Input field for number) What is your age? (Input field for number) What is the highest level of education you have completed? (8th grade, Some high school, High school graduate, Vocational or technical school, Some college, Associate degree, Bachelor’s degree, Graduate work, Ph.D., I prefer not to say) What is the highest level of education you have completed? (8th grade, Some high school, High school graduate, Vocational or technical school, Some college, Associate degree, Bachelor’s degree, Graduate work, Ph.D., I prefer not to say) What is the level of your English proficiency? (Proficient, Independent, Basic) What is the level of your English proficiency? (Proficient, Independent, Basic) Do you consider yourself to be liberal, conservative, or somewhere in between? Please slide to record your response. (Very liberal to Very conservative, -10 to 10 point slider) Do you consider yourself to be liberal, conservative, or somewhere in between? Please slide to record your response. (Very liberal to Very conservative, -10 to 10 point slider) How often on average do you check the news? (Never, Very rarely, Several times per month, Several times per week, Every day, Several times per day) How often on average do you check the news? (Never, Very rarely, Several times per month, Several times per week, Every day, Several times per day) Info on Media Bias Info on Media Bias Before you can start we will now provide you with a few examples that should help you to understand possible media bias instances better. For each example, a sentence with a biased word (blue colored) is shown first followed by its impartial representation (green colored). Please note that bias is different from negative sentiment. Bias is ambiguous and subtle, it can be positive, negative, or not even have a particular sentiment but it still can imply or intensify the opinion/emotion Subjective Intensifiers: Subjective Intensifiers Schnabel himself did the fantastic reproductions of Basquiat’s work. Schnabel himself did the accurate reproductions of Basquiat’s work. Strong labels: Strong labels: ’The people want the Truth!’: Trump gloats over the loss of American media jobs. ’The people want the Truth!’: Trump tweets over the loss of American media jobs. One-sided terms: One-sided terms: Concerned Women for America’s major areas of political activity have consisted of opposition to gay causes, pro-life law... Concerned Women for America’s major areas of political activity have consisted of opposition to gay causes, anti-abortion law... Attention Check on Bias Attention Check on Bias How is bias connected to sentiment? Based on the information that was provided to you earlier, please select the correct option. How is bias connected to sentiment? •   Bias is the same as negative sentiment. •   Bias can be both positive, negative or even not have par- ticular sentiment. (correct answer) •   Bias is the same as positive sentiment. •   Bias is not connected to sentiment at all. Trust Check Trust Check Can we trust your data for scientific research? For example, if you failed to pay attention to some questions, please answer ’No’. Please answer honestly, you will receive full payment regardless of your answer. Please select one option. (Yes, you can trust my data for scientific research. No, you may not want to trust my data for scientific research.) Can we trust your data for scientific research? Authors:
(1) Smi Hinterreiter;
(2) Martin Wessel;
(3) Fabian Schliski;
(4) Isao Echizen;
(5) Marc Erich Latoschik;
(6) Timo Spinde. Authors: Authors: (1) Smi Hinterreiter; (2) Martin Wessel; (3) Fabian Schliski; (4) Isao Echizen; (5) Marc Erich Latoschik; (6) Timo Spinde. This paper is available on arxiv under CC0 1.0 license. This paper is available on arxiv under CC0 1.0 license. available on arxiv

Part of HackerNoon's growing list of open-source research papers, promoting free access to academic material.

Every

Inside the Research Project Examining Hidden Bias in News Coverage

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

A Comprehensive Overview of Image Generation Models: From GANs to Diffusion Techniques

Can User Feedback Fix Slanted News? Researchers Think So

Human-in-the-Loop Models Could Improve Media Bias Detection, Study Finds

Color-Coded Bias Warnings Boost Accuracy and Efficiency in AI Feedback

NewsUnfold Tests a Crowdsourced Approach to Detecting Media Bias

User Feedback Boosts Media-Bias Dataset Accuracy in NewsUnfold Evaluation

A Comprehensive Overview of Image Generation Models: From GANs to Diffusion Techniques

Can User Feedback Fix Slanted News? Researchers Think So

Human-in-the-Loop Models Could Improve Media Bias Detection, Study Finds

Color-Coded Bias Warnings Boost Accuracy and Efficiency in AI Feedback

NewsUnfold Tests a Crowdsourced Approach to Detecting Media Bias

User Feedback Boosts Media-Bias Dataset Accuracy in NewsUnfold Evaluation

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps