A Roadmap for User Empowerment in the Dark Pattern Landscape

Authors: (1) Yuwen Lu, he contributed equally to this work, University of Notre Dame, USA; (2) Chao Zhang, he contributed equally to this work and work done as a visiting researcher at the University of Notre Dame; (3) Yuewen Yang, Work done as a visiting researcher at the University of Notre Dame; (4) Yaxin Yao, Virginia Tech, USA; (5) Toby Jia-Jun Li, University of Notre Dame, USA. Table of Links Introduction Background and Related Work Co-Design Workshops Technology Probe Study Results Scaling Up: A Research Agenda Limitations and Future Work Conclusions and References Appendix 8 CONCLUSION Through a series of co-design workshops and a 2-week deployment study of a technology probe, we proposed and tested an end-user-empowerment approach for dark pattern intervention. We discussed implications for the design of future interventions to support users’ awareness and actions against undesired UX dark patterns. Our approach presents opportunities in coordinating with the ongoing efforts in addressing dark patterns from the perspectives of designers, educators, and policymakers. We laid out a research agenda to scale up this approach by utilizing developments in crowd-sourced collective intelligence, citizen science platforms, computational UI techniques, and user behavior modeling to guide future work in this domain. REFERENCES [1] Jacob Aagaard, Miria Emma Clausen Knudsen, Per Bækgaard, and Kevin Doherty. 2022. A Game of Dark Patterns: Designing Healthy, Highly-Engaging Mobile Games. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–8. https: //doi.org/10.1145/3491101.3519837 [2] Sanju Ahuja and Jyoti Kumar. 2022. Conceptualizations of User Autonomy within the Normative Evaluation of Dark Patterns. Ethics and Information Technology 24, 4 (Dec. 2022), 52. https://doi.org/10.1007/s10676-022-09672-9 [3] BJ Allen, Deepa Chandrasekaran, and Suman Basuroy. 2018. Design crowdsourcing: The impact on new product performance of sourcing design solutions from the “crowd”. Journal of Marketing 82, 2 (2018), 106–123. [4] Sérgio Alves, Ricardo Costa, Kyle Montague, and Tiago Guerreiro. 2023. GitUI: A Community-Based Platform to Democratize User Interfaces. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–6. [5] Amazon. 2022. Items on Amazon may display a List Price, Was Price, or other strike-through pricing or saving information on the product detail page. https://www.amazon.com/gp/help/customer/display.html?nodeId=GQ6B6RH72AX8D2TD&ref_=dp_hp [6] Roy F Baumeister. 2002. Yielding to temptation: Self-control failure, impulsive purchasing, and consumer behavior. Journal of consumer Research 28, 4 (2002), 670–676. [7] European Data Protection Board. 2020. Guidelines 05/2020 on consent under Regulation 2016/679. https://edpb. europa.eu/our-work-tools/our-documents/guidelines/guidelines-052020-consent-under-regulation-2016679_en [8] European Data Protection Board. 2022. Guidelines 3/2022 on Dark Patterns in Social Media Platform Interfaces: How to Recognise and Avoid Them. Technical Report. European Data Protection Board, Brussels, Belgique. [9] Susanne Bodker. 1999. Scenarios in user-centred design-setting the stage for reflection and action. In Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers. IEEE, Maui, HI, USA, 11–pp. [10] Michael Bolin, Matthew Webber, Philip Rha, Tom Wilson, and Robert C. Miller. 2005. Automation and customization of rendered web pages. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST ’05). Association for Computing Machinery, New York, NY, USA, 163–172. https://doi.org/10.1145/1095034.1095062 [11] Kerstin Bongard-Blanchy, Arianna Rossi, Salvador Rivas, Sophie Doublet, Vincent Koenig, and Gabriele Lenzini. 2021. ”I am Definitely Manipulated, Even When I am Aware of it. It’s Ridiculous!” - Dark Patterns from the End-User Perspective. In Designing Interactive Systems Conference 2021 (DIS ’21). Association for Computing Machinery, New York, NY, USA, 763–776. https://doi.org/10.1145/3461778.3462086 [12] Rick Bonney, Jennifer L Shirk, Tina B Phillips, Andrea Wiggins, Heidi L Ballard, Abraham J Miller-Rushing, and Julia K Parrish. 2014. Next steps for citizen science. Science 343, 6178 (2014), 1436–1437. [13] David M. Boush, Marian Friestad, and Peter Wright. 2016. Deception In The Marketplace: The Psychology of Deceptive Persuasion and Consumer Self-Protection. Routledge, New York. https://doi.org/10.4324/9780203805527 [14] Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101. [15] Harry Brignull. 2010. Deceptive design - Types of deceptive design. https://www.deceptive.design/types [16] Christoph Bösch, Benjamin Erb, Frank Kargl, Henning Kopp, and Stefan Pfattheicher. 2016. Tales from the Dark Side: Privacy Dark Strategies and Privacy Dark Patterns. Proceedings on Privacy Enhancing Technologies 2016, 4 (Oct. 2016), 237–254. https://doi.org/10.1515/popets-2016-0038 [17] Ana Caraban, Evangelos Karapanos, Daniel Gonçalves, and Pedro Campos. 2019. 23 Ways to Nudge: A Review of Technology-Mediated Nudging in Human-Computer Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–15. https://doi.org/10.1145/3290605.3300733 [18] Kerry Shih-Ping Chang and Brad A. Myers. 2012. WebCrystal: understanding and reusing examples in web authoring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). Association for Computing Machinery, New York, NY, USA, 3205–3214. https://doi.org/10.1145/2207676.2208740 [19] Akash Chaudhary, Jaivrat Saroha, Kyzyl Monteiro, Angus G. Forbes, and Aman Parnami. 2022. “Are You Still Watching?”: Exploring Unintended User Behaviors and Dark Patterns on Video Streaming Platforms. In Designing Interactive Systems Conference (DIS ’22). Association for Computing Machinery, New York, NY, USA, 776–791. https://doi.org/10.1145/3532106.3533562 [20] Akash Chaudhary, Jaivrat Saroha, Kyzyl Monteiro, Angus G. Forbes, and Aman Parnami. 2022. “Are You Still Watching?”: Exploring Unintended User Behaviors and Dark Patterns on Video Streaming Platforms. In Designing Interactive Systems Conference (DIS ’22). Association for Computing Machinery, New York, NY, USA, 776–791. https://doi.org/10.1145/3532106.3533562 [21] Shruthi Sai Chivukula, Jason Brier, and Colin M. Gray. 2018. Dark Intentions or Persuasion? UX Designers’ Activation of Stakeholder and User Values. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems (Hong Kong, China) (DIS ’18 Companion). Association for Computing Machinery, New York, NY, USA, 87–91. https://doi.org/10.1145/3197391.3205417 [22] Federal Trade Commision. 2022. Bringing Dark Patterns to Light. Technical Report. Federal Trade Commision. 48 pages. [23] European Commission, Directorate-General for Justice, Consumers, F Lupiáñez-Villanueva, A Boluda, F Bogliacino, G Liva, L Lechardoy, and T Rodríguez de las Heras Ballell. 2022. Behavioural study on unfair commercial practices in the digital environment : dark patterns and manipulative personalisation : final report. Publications Office of the European Union, Brussels, Belgium. https://doi.org/10.2838/859030 [24] Gregory Conti and Edward Sobiesk. 2010. Malicious interface design: exploiting the user. In Proceedings of the 19th international conference on World wide web (WWW ’10). Association for Computing Machinery, New York, NY, USA, 271–280. https://doi.org/10.1145/1772690.1772719 [25] Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017. Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). ACM, New York, NY, USA, 845–854. https://doi.org/10.1145/3126594.3126651 [26] Linda Di Geronimo, Larissa Braz, Enrico Fregnan, Fabio Palomba, and Alberto Bacchelli. 2020. UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception. Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376600 [27] Jordan Donnelly, Alan Downley, Yunpeng Liu, Yufei Su, Quanwei Sun, Lan Zeng, Andrea Curley, Damian Gordon, Paul Kelly, Dympna O’Sullivan, and Anna Becevel. 2022. “Be a Pattern for the World”: The Development of a Dark Patterns Detection Tool to Prevent Online User Loss. In Proceedings of Ethicomp, 20th International Conference on the Ethical and Social Issues in Information and Communication Technologies. University of Turku, Turku, Finland, 578–582. https://doi.org/10.21427/2Y2Q-6323 [28] Brianna Dym, Cecilia Aragon, Julia Bullard, Ruby Davis, and Casey Fiesler. 2018. Online fandom: Boldly going where few CSCW researchers have gone before. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. Association for Computing Machinery, New York, NY, USA, 121–124. [29] Malin Eiband, Hanna Schneider, Mark Bilandzic, Julian Fazekas-Con, Mareike Haug, and Heinrich Hussmann. 2018. Bringing transparency design into practice. In 23rd international conference on intelligent user interfaces. 211–223. [30] Casey Fiesler, Shannon Morrison, R Benjamin Shapiro, and Amy S Bruckman. 2017. Growing their own: Legitimate peripheral participation for computational learning in an online fandom community. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. Association for Computing Machinery, New York, NY, USA, 1375–1386. [31] Diego Firmenich, Sergio Firmenich, Gustavo Rossi, Marco Winckler, and Damiano Distante. 2015. User interface adaptation using web augmentation techniques: towards a negotiated approach. In Engineering the Web in the Big Data Era: 15th International Conference, ICWE 2015, Rotterdam, The Netherlands, June 23-26, 2015, Proceedings 15. Springer, New York, NY, USA, 147–164. [32] United States Senator Deb Fischer. 2019. Senators Introduce Bipartisan Legislation to Ban Manipulative ’Dark Patterns’. http://www.fischer.senate.gov/public/index.cfm/2019/4/senators-introduce-bipartisan-legislation-to-banmanipulative-dark-patterns [33] Michael J. Fitzgerald. 2008. CopyStyler : Web design by example. Thesis. Massachusetts Institute of Technology. https://dspace.mit.edu/handle/1721.1/46032 Accepted: 2009-06-30T17:06:01Z Journal Abbreviation: Web design by example. [34] Sandy J. J. Gould, Lewis L. Chuang, Ioanna Iacovides, Diego Garaialde, Marta E. Cecchinato, Benjamin R. Cowan, and Anna L. Cox. 2021. A Special Interest Group on Designed and Engineered Friction in Interaction. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3411763.3450404 [35] Colin M. Gray, Jingle Chen, Shruthi Sai Chivukula, and Liyang Qu. 2021. End User Accounts of Dark Patterns as Felt Manipulation. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 372 (oct 2021), 25 pages. https://doi.org/10.1145/ 3479516 [36] Colin M. Gray, Shruthi Sai Chivukula, Kerstin Bongard-Blanchy, Arunesh Mathur, Johanna T. Gunawan, and Brennan Schaffner. 2023. Emerging Transdisciplinary Perspectives to Confront Dark Patterns. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3544549.3583745 [37] Colin M. Gray, Shruthi Sai Chivukula, and Ahreum Lee. 2020. What Kind of Work Do "Asshole Designers" Create? Describing Properties of Ethical Concern on Reddit. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. ACM, Eindhoven Netherlands, 61–73. https://doi.org/10.1145/3357236.3395486 [38] Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The Dark (Patterns) Side of UX Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3173574.3174108 [39] Colin M. Gray, Lorena Sanchez Chamorro, Ike Obi, and Ja-Nae Duane. 2023. Mapping the Landscape of Dark Patterns Scholarship: A Systematic Literature Review. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (DIS ’23 Companion). Association for Computing Machinery, New York, NY, USA, 188–193. https://doi.org/10.1145/3563703.3596635 [40] Colin M. Gray, Cristiana Santos, and Nataliia Bielova. 2023. Towards a Preliminary Ontology of Dark Patterns Knowledge. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3544549.3585676 [41] Colin M. Gray, Cristiana Teixeira Santos, Nicole Tong, Thomas Mildner, Arianna Rossi, Johanna T. Gunawan, and Caroline Sinders. 2023. Dark Patterns and the Emerging Threats of Deceptive Design Practices. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3544549.3583173 [42] Paul Graßl, Hanna Schraffenberger, Frederik Zuiderveen Borgesius, and Moniek Buijzen. 2021. Dark and Bright Patterns in Cookie Consent Requests. Journal of Digital Social Research 3, 1 (Feb. 2021), 1–38. https://doi.org/10. 33621/jdsr.v3i1.54 Number: 1. [43] Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark patterns in proxemic interactions: a critical perspective. In Proceedings of the 2014 conference on Designing interactive systems (DIS ’14). Association for Computing Machinery, New York, NY, USA, 523–532. https://doi.org/10.1145/2598510.2598541 [44] Johanna Gunawan, Amogh Pradeep, David Choffnes, Woodrow Hartzog, and Christo Wilson. 2021. A Comparative Study of Dark Patterns Across Web and Mobile Modalities. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (Oct. 2021), 377:1–377:29. https://doi.org/10.1145/3479521 [45] Johanna Gunawan, Cristiana Santos, and Irene Kamara. 2022. Redress for Dark Patterns Privacy Harms? A Case Study on Consent Interactions. In Proceedings of the 2022 Symposium on Computer Science and Law (CSLAW ’22). Association for Computing Machinery, New York, NY, USA, 181–194. https://doi.org/10.1145/3511265.3550448 [46] Pelle Guldborg Hansen and Andreas Maaløe Jespersen. 2013. Nudge and the Manipulation of Choice: A Framework for the Responsible Use of the Nudge Approach to Behaviour Change in Public Policy. European Journal of Risk Regulation 4, 1 (March 2013), 3–28. https://doi.org/10.1017/S1867299X00002762 [47] Ralph Hertwig and Till Grüne-Yanoff. 2017. Nudging and Boosting: Steering or Empowering Good Decisions. Perspectives on Psychological Science 12, 6 (Nov. 2017), 973–986. https://doi.org/10.1177/1745691617702496 Publisher: SAGE Publications Inc. [48] Shun Hidaka, Sota Kobuki, Mizuki Watanabe, and Katie Seaborn. 2023. Linguistic Dead-Ends and Alphabet Soup: Finding Dark Patterns in Japanese Apps. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3544548. 3580942 [49] Wilhelm Hofmann, Malte Friese, and Fritz Strack. 2009. Impulse and self-control from a dual-systems perspective. Perspectives on psychological science 4, 2 (2009), 162–176. [50] Forrest Huang, John F. Canny, and Jeffrey Nichols. 2019. Swire: Sketch-Based User Interface Retrieval. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, New York, NY, USA, 1–10. https://doi.org/10.1145/3290605.3300334 [51] Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03). Association for Computing Machinery, New York, NY, USA, 17–24. https: //doi.org/10.1145/642611.642616 [52] Yue Jiang, Yuwen Lu, Jeffrey Nichols, Wolfgang Stuerzlinger, Chun Yu, Christof Lutteroth, Yang Li, Ranjitha Kumar, and Toby Jia-Jun Li. 2022. Computational Approaches for Understanding, Generating, and Adapting User Interfaces. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3491101.3504030 [53] Haojian Jin, Boyuan Guo, Rituparna Roychoudhury, Yaxing Yao, Swarun Kumar, Yuvraj Agarwal, and Jason I. Hong. 2022. Exploring the Needs of Users for Supporting Privacy-Protective Behaviors in Smart Homes. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–19. https://doi.org/10.1145/3491102.3517602 [54] Harmanpreet Kaur, Harsha Nori, Samuel Jenkins, Rich Caruana, Hanna Wallach, and Jennifer Wortman Vaughan. 2020. Interpreting Interpretability: Understanding Data Scientists’ Use of Interpretability Tools for Machine Learning. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376219 [55] Maxwell Keleher, Fiona Westin, Preethi Nagabandi, and Sonia Chiasson. 2022. How Well Do Experts Understand End-Users’ Perceptions of Manipulative Patterns?. In Nordic Human-Computer Interaction Conference. Association for Computing Machinery, New York, NY, USA, 1–21. [56] Tae Soo Kim, DaEun Choi, Yoonseo Choi, and Juho Kim. 2022. Stylette: Styling the Web with Natural Language. In CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3491102.3501931 [57] Konrad Kollnig, Siddhartha Datta, and Max Van Kleek. 2021. I Want My App That Way: Reclaiming Sovereignty Over Personal Devices. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3411763.3451632 [58] Monica Kowalczyk, Johanna T. Gunawan, David Choffnes, Daniel J Dubois, Woodrow Hartzog, and Christo Wilson. 2023. Understanding Dark Patterns in Home IoT Devices. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–27. https: //doi.org/10.1145/3544548.3581432 [59] Cliff Kuang and Robert Fabricant. 2019. User friendly: How the hidden rules of design are changing the way we live, work & play. Random House, New York. [60] Ranjitha Kumar, Jerry O. Talton, Salman Ahmad, and Scott R. Klemmer. 2011. Bricolage: example-based retargeting for web design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2197–2206. https://doi.org/10.1145/1978942.1979262 [61] Cherie Lacey and Catherine Caudwell. 2019. Cuteness as a ‘Dark Pattern’ in Home Robots. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (2019-03). IEEE, Daegu, South Korea, 374–381. https: //doi.org/10.1109/HRI.2019.8673274 [62] Pat Langley. 1999. User modeling in adaptive interface. In UM99 User Modeling. Springer, Udine, Italy, 357–370. [63] Jonathan Lazar, Jinjuan Heidi Feng, and Harry Hochheiser. 2017. Research methods in human-computer interaction. Morgan Kaufmann, Chichester, West Sussex, U.K. [64] Brian Lee, Savil Srivastava, Ranjitha Kumar, Ronen Brafman, and Scott R. Klemmer. 2010. Designing with interactive example galleries. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10). Association for Computing Machinery, New York, NY, USA, 2257–2266. https://doi.org/10.1145/1753326.1753667 [65] M. R. Leiser. 2020. ’Dark Patterns’: The Case for Regulatory Pluralism. SSRN Scholarly Paper 3625637. Social Science Research Network, Rochester, NY. https://doi.org/10.2139/ssrn.3625637 [66] Chris Lewis. 2014. Irresistible Apps: Motivational Design Patterns for Apps, Games, and Web-based Communities (1st ed.). Apress, USA. [67] Toby Jia-Jun Li, Amos Azaria, and Brad A. Myers. 2017. SUGILITE: Creating Multimodal Smartphone Automation by Demonstration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 6038–6049. https://doi.org/10.1145/3025453.3025483 [68] Toby Jia-Jun Li, Lindsay Popowski, Tom Mitchell, and Brad A Myers. 2021. Screen2Vec: Semantic Embedding of GUI Screens and GUI Components. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3411764.3445049 [69] Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, and Brad A. Myers. 2019. PUMICE: A Multi-Modal Agent That Learns Concepts and Conditionals from Natural Language and Demonstrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 577–589. https://doi.org/10.1145/3332165.3347899 [70] Toby Jia-Jun Li and Oriana Riva. 2018. Kite: Building Conversational Bots from Mobile Apps. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’18). Association for Computing Machinery, New York, NY, USA, 96–109. https://doi.org/10.1145/3210240.3210339 [71] Sarah Lim, Joshua Hibschman, Haoqi Zhang, and Eleanor O’Rourke. 2018. Ply: A Visual Web Inspector for Learning from Professional Webpages. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ’18). Association for Computing Machinery, New York, NY, USA, 991–1002. https://doi.org/10. 1145/3242587.3242660 [72] Evan Zheran Liu, Kelvin Guu, Panupong Pasupat, Tianlin Shi, and Percy Liang. 2018. Reinforcement Learning on Web Interfaces Using Workflow-Guided Exploration. http://arxiv.org/abs/1802.08802 arXiv:1802.08802 [cs]. [73] Jamie Luguri and Lior Jacob Strahilevitz. 2021. Shining a Light on Dark Patterns. Journal of Legal Analysis 13, 1 (Jan. 2021), 43–109. https://doi.org/10.1093/jla/laaa006 [74] Kai Lukoff, Alexis Hiniker, Colin M. Gray, Arunesh Mathur, and Shruthi Sai Chivukula. 2021. What Can CHI Do About Dark Patterns?. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 102, 6 pages. https://doi.org/10.1145/3411763.3441360 [75] Ulrik Lyngs, Kai Lukoff, Petr Slovak, William Seymour, Helena Webb, Marina Jirotka, Jun Zhao, Max Van Kleek, and Nigel Shadbolt. 2020. ’I Just Want to Hack Myself to Not Get Distracted’: Evaluating Design Interventions for Self-Control on Facebook. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376672 [76] Aditi M. Bhoot, Mayuri A. Shinde, and Wricha P. Mishra. 2020. Towards the Identification of Dark Patterns: An Analysis Based on End-User Reactions. In IndiaHCI ’20: Proceedings of the 11th Indian Conference on HumanComputer Interaction (IndiaHCI 2020). Association for Computing Machinery, New York, NY, USA, 24–33. https: //doi.org/10.1145/3429290.3429293 [77] Maximilian Maier. 2019. Dark patterns–An end user perspective. [78] Maximilian Maier and Rikard Harr. 2020. Dark Design Patterns: An End-User Perspective. Human Technology 16, 2 (2020), 170–199. https://doi.org/10.17011/ht/urn.202008245641 [79] SM Mansur, Sabiha Salma, Damilola Awofisayo, and Kevin Moran. 2023. AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces. [80] Autoriteit Consument & Markt. 2020. Guidelines on the protection of the online consumer | . https: Last Modified: 2020-11-23T14:40:37+0100. ACM.nl //www.acm.nl/en/publications/guidelines-protection-online-consumer [81] Arunesh Mathur, Gunes Acar, Michael J. Friedman, Eli Lucherini, Jonathan Mayer, Marshini Chetty, and Arvind Narayanan. 2019. Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 81 (nov 2019), 32 pages. https://doi.org/10.1145/3359183 [82] Arunesh Mathur, Mihir Kshirsagar, and Jonathan Mayer. 2021. What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methods. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 360, 18 pages. https://doi.org/10.1145/3411764.3445610 [83] Arunesh Mathur, Arvind Narayanan, and Marshini Chetty. 2018. Endorsements on Social Media: An Empirical Study of Affiliate Marketing Disclosures on YouTube and Pinterest. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1–26. https://doi.org/10.1145/3274388 [84] Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (Nov. 2019), 72:1–72:23. https://doi.org/10.1145/3359174 [85] Thomas Mildner, Merle Freye, Gian-Luca Savino, Philip R. Doyle, Benjamin R. Cowan, and Rainer Malaka. 2023. Defending Against the Dark Arts: Recognising Dark Patterns in Social Media. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS ’23). Association for Computing Machinery, New York, NY, USA, 2362–2374. https://doi.org/10.1145/3563657.3595964 [86] Thomas Mildner and Gian-Luca Savino. 2021. Ethical User Interfaces: Exploring the Effects of Dark Patterns on Facebook. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3411763.3451659 [87] Thomas Mildner, Gian-Luca Savino, Philip R. Doyle, Benjamin R. Cowan, and Rainer Malaka. 2023. About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3544548.3580695 [88] Neema Moraveji, Jason Li, Jiarong Ding, Patrick O’Kelley, and Suze Woolf. 2007. Comicboarding: using comics as proxies for participatory design with children. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’07). Association for Computing Machinery, New York, NY, USA, 1371–1374. https: //doi.org/10.1145/1240624.1240832 [89] Carol Moser, Sarita Y. Schoenebeck, and Paul Resnick. 2019. Impulse Buying: Design Practices and Consumer Needs. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300472 [90] Michael J. Muller and Sarah Kuhn. 1993. Participatory Design. Commun. ACM 36, 6 (June 1993), 24–28. https: //doi.org/10.1145/153571.255960 [91] Brad A Myers, Andrew J Ko, Chris Scaffidi, Stephen Oney, YoungSeok Yoon, Kerry Chang, Mary Beth Kery, and Toby Jia-Jun Li. 2017. Making end user development more natural. In New perspectives in end-user development. Springer, New York, NY, 1–22. [92] Arvind Narayanan, Arunesh Mathur, Marshini Chetty, and Mihir Kshirsagar. 2020. Dark Patterns: Past, Present, and Future: The Evolution of Tricky User Interfaces. Queue 18, 2 (apr 2020), 67–92. https://doi.org/10.1145/3400899.3400901 [93] Michael Nebeling and Anind K. Dey. 2016. XDBrowser: User-Defined Cross-Device Web Page Designs. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). Association for Computing Machinery, New York, NY, USA, 5494–5505. https://doi.org/10.1145/2858036.2858048 [94] Michael Nebeling, Maximilian Speicher, and Moira C. Norrie. 2013. CrowdAdapt: enabling crowdsourced web page adaptation for individual viewing conditions and preferences. In Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems (EICS ’13). Association for Computing Machinery, New York, NY, USA, 23–32. https://doi.org/10.1145/2494603.2480304 [95] Michael Nebeling, Maximilian Speicher, and Moira C Norrie. 2013. CrowdAdapt: enabling crowdsourced web page adaptation for individual viewing conditions and preferences. In Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems. Association for Computing Machinery, New York, NY, USA, 23–32. [96] Jeffrey Nichols and Brad A. Myers. 2009. Creating a Lightweight User Interface Description Language: An Overview and Analysis of the Personal Universal Controller Project. ACM Trans. Comput.-Hum. Interact. 16, 4, Article 17 (nov 2009), 37 pages. https://doi.org/10.1145/1614390.1614392 [97] Jeffrey Nichols, Brad A. Myers, Michael Higgins, Joseph Hughes, Thomas K. Harris, Roni Rosenfeld, and Mathilde Pignol. 2002. Generating Remote Control Interfaces for Complex Appliances. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (Paris, France) (UIST ’02). Association for Computing Machinery, New York, NY, USA, 161–170. https://doi.org/10.1145/571985.572008 [98] Brian A Nosek, George Alter, George C Banks, Denny Borsboom, Sara D Bowman, Steven J Breckler, Stuart Buck, Christopher D Chambers, Gilbert Chin, Garret Christensen, et al. 2015. Promoting an open research culture. Science 348, 6242 (2015), 1422–1425. [99] Brian A Nosek, Charles R Ebersole, Alexander C DeHaven, and David T Mellor. 2018. The preregistration revolution. Proceedings of the National Academy of Sciences 115, 11 (2018), 2600–2606. [100] Midas Nouwens, Rolf Bagge, Janus Bager Kristensen, and Clemens Nylandsted Klokmose. 2022. Consent-O-Matic: Automatically Answering Consent Pop-Ups Using Adversarial Interoperability. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3491101.3519683 [101] Midas Nouwens, Ilaria Liccardi, Michael Veale, David Karger, and Lalana Kagal. 2020. Dark Patterns after the GDPR: Scraping Consent Pop-Ups and Demonstrating Their Influence. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376321 [102] Jonas Oppenlaender, Thanassis Tiropanis, and Simo Hosio. 2020. CrowdUI: Supporting Web Design with the Crowd. Proceedings of the ACM on Human-Computer Interaction 4, EICS (June 2020), 76:1–76:28. https://doi.org/10.1145/ 3394978 [103] Jonas Oppenlaender, Thanassis Tiropanis, and Simo Hosio. 2020. CrowdUI: Supporting Web Design with the Crowd. Proceedings of the ACM on Human-Computer Interaction 4, EICS (2020), 1–28. [104] Thomas H. Park, Ankur Saxena, Swathi Jagannath, Susan Wiedenbeck, and Andrea Forte. 2013. OpenHTML: designing a transitional web editor for novices. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 1863–1868. https://doi.org/10.1145/2468356.2468690 [105] Sarah Prange, Niklas Thiem, Michael Fröhlich, and Florian Alt. 2022. “Secure settings are quick and easy!”–Motivating End-Users to Choose Secure Smart Home Configurations. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces. John Wiley & Sons, Hoboken, New Jersey, 1–9. [106] Ronald W. Rogers. 1975. A protection motivation theory of fear appeals and attitude change. The journal of psychology 91, 1 (1975), 93–114. Publisher: Taylor & Francis. [107] Brennan Schaffner, Neha A. Lingareddy, and Marshini Chetty. 2022. Understanding Account Deletion and Relevant Dark Patterns on Social Media. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 417:1–417:43. https://doi.org/10.1145/3555142 [108] William Seymour, Martin J. Kraemer, Reuben Binns, and Max Van Kleek. 2020. Informing the Design of PrivacyEmpowering Tools for the Connected Home. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831. 3376264 [109] Ben Shneiderman. 2022. Human-centered AI. Oxford University Press. [110] Ray Sin, Ted Harris, Simon Nilsson, and Talia Beck. 2022. Dark patterns in online shopping: do they work and can nudges help mitigate impulse buying? Behavioural Public Policy 1, 1 (2022), 1–27. [111] Dan Siroker and Pete Koomen. 2015. A/B testing: The most powerful way to turn clicks into customers. John Wiley & Sons, Hoboken, New Jersey. [112] Daniel Smullen, Yaxing Yao, Yuanyuan Feng, Norman Sadeh, Arthur Edelstein, and Rebecca Weiss. 2021. Managing Potentially Intrusive Practices in the Browser: A User-Centered Perspective. In Proceedings on Privacy Enhancing Technologies (PETS ’21, Vol. 2021). Sciendo, The Internet, 500–527. https://doi.org/10.2478/popets-2021-0082 [113] Carolyn Snyder. 2003. Paper prototyping: The fast and easy way to design and refine user interfaces. Morgan Kaufmann, San Franciso, CA. [114] Robert Soden, Michael Skirpan, Casey Fiesler, Zahra Ashktorab, Eric P. S. Baumer, Mark Blythe, and Jasmine Jones. 2019. CHI4EVIL: Creative Speculation on the Negative Impacts of HCI Research. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3290607.3299033 [115] Than Htut Soe, Cristiana Teixeira Santos, and Marija Slavkovik. 2022. Automated Detection of Dark Patterns in Cookie Banners: How to Do It Poorly and Why It Is Hard to Do It Any Other Way. https://doi.org/10.48550/arXiv.2204.11836 arXiv:2204.11836 [cs] [116] Peter Story. 2021. Design and Evaluation of Security and Privacy Nudges: From Protection Motivation Theory to Implementation Intentions. Ph. D. Dissertation. Carnegie Mellon University. [117] Peter Story, Daniel Smullen, Rex Chen, Yaxing Yao, Alessandro Acquisti, Lorrie Faith Cranor, Norman Sadeh, and Florian Schaub. 2022. Increasing adoption of tor browser using informational and planning nudges. UMBC Faculty Collection (2022). [118] Wolfgang Stuerzlinger, Olivier Chapuis, Dusty Phillips, and Nicolas Roussel. 2006. User interface façades: towards fully adaptable user interfaces. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST ’06). Association for Computing Machinery, New York, NY, USA, 309–318. https://doi.org/10.1145/ 1166253.1166301 [119] Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (HTTF 2019). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3363384.3363402 [120] JaYoung Sung, Henrik I Christensen, and Rebecca E Grinter. 2009. Robots in the wild: understanding long-term use. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. Association for Computing Machinery, New York, NY, USA, 45–52. [121] Michael Toth, Nataliia Bielova, and Vincent Roca. 2022. On dark patterns and manipulation of website publishers by CMPs. Proceedings on Privacy Enhancing Technologies 2022, 3 (July 2022), 478–497. https://doi.org/10.56553/popets2022-0082 [122] Khai N. Truong, Gillian R. Hayes, and Gregory D. Abowd. 2006. Storyboarding: an empirical determination of best practices and effective guidelines. In Proceedings of the 6th conference on Designing Interactive systems (DIS ’06). Association for Computing Machinery, New York, NY, USA, 12–21. https://doi.org/10.1145/1142405.1142410 [123] Massimo Turatto, Massimo Vescovi, and Matteo Valsecchi. 2007. Attention makes moving objects be perceived to move faster. Vision Research 47, 2 (2007), 166–178. https://doi.org/10.1016/j.visres.2006.10.002 [124] Blase Ur, Pedro Giovanni Leon, Lorrie Faith Cranor, Richard Shay, and Yang Wang. 2012. Smart, useful, scary, creepy: perceptions of online behavioral advertising. In Proceedings of the Eighth Symposium on Usable Privacy and Security (SOUPS ’12). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/2335356. 2335362 [125] René Van Bavel, Nuria Rodríguez-Priego, José Vila, and Pam Briggs. 2019. Using protection motivation theory in the design of nudges to improve online security behavior. International Journal of Human-Computer Studies 123 (2019), 29–39. [126] Yang Wang, Pedro Giovanni Leon, Alessandro Acquisti, Lorrie Faith Cranor, Alain Forget, and Norman Sadeh. 2014. A field trial of privacy nudges for facebook. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 2367–2376. https://doi.org/10.1145/2556288.2557413 [127] Mark Warner. 2021. Lawmakers Reintroduce Bipartisan Bicameral Legislation to Ban Manipulative ’Dark Patterns’. https://www.warner.senate.gov/public/index.cfm/2021/12/lawmakers-reintroduce-bipartisan-bicamerallegislation-to-ban-manipulative-dark-patterns [128] Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, and Yunxin Liu. 2023. Empowering LLM to use Smartphone for Intelligent Task Automation. arXiv:2308.15272 [cs.AI] [129] Anders Wikström and Roberto Verganti. 2013. Exploring storyboarding in pre-brief activities. In Proceedings of the 19th International Conference on Engineering Design (ICED ’13, Vol. 7). Design Society, Seoul, Korea, 011–020. https://www.designsociety.org/publication/34565/Exploring+storyboarding+in+pre-brief+activities ISBN: 9781904670506. [130] Richard Wilson et al. 2022. Dark Patterns and Epistemic Ignorance: An Educational Crisis. In European Conference on the Impact of Artificial Intelligence and Robotics, Vol. 4. Academic Conferences International, Curtis Farm, United Kingdom, 78–84. [131] Hongzhi Yin, Bin Cui, Ling Chen, Zhiting Hu, and Zi Huang. 2014. A temporal context-aware model for user behavior modeling in social media systems. In Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data (SIGMOD ’14). Association for Computing Machinery, New York, NY, USA, 1543–1554. https://doi.org/10.1145/2588555.2593685 [132] José P. Zagal, Staffan Björk, and Chris Lewis. 2013. Dark patterns in the design of games. In Foundations of Digital Games 2013. Society for the Advancement of the Science of Digital Games, Chania, Greece, 1–8. [133] Xiong Zhang and Philip J. Guo. 2018. Fusion: Opportunistic Web Prototyping with UI Mashups. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST ’18). Association for Computing Machinery, New York, NY, USA, 951–962. https://doi.org/10.1145/3242587.3242632 [134] Zheng Zhang, Ying Xu, Yanhao Wang, Bingsheng Yao, Daniel Ritchie, Tongshuang Wu, Mo Yu, Dakuo Wang, and Toby Jia-Jun Li. 2022. StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement. In CHI Conference on Human Factors in Computing Systems (CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–21. https://doi.org/10.1145/3491102.3517479 [135] Chang Zhou, Jinze Bai, Junshuai Song, Xiaofei Liu, Zhengchao Zhao, Xiusi Chen, and Jun Gao. 2018. ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI ’18, Vol. 32). AAAI, New Orleans, Louisiana, USA, 4564–4571. https://doi.org/10.1609/ aaai.v32i1.11618 [136] Yixin Zou, Kevin Roundy, Acar Tamersoy, Saurabh Shintre, Johann Roturier, and Florian Schaub. 2020. Examining the Adoption and Abandonment of Security, Privacy, and Identity Theft Protection Practices. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376570 This paper is under CC 4.0 license. available on arxiv