BELIV: Learning What's True, Doing What's Right


Session chair:TBA

Room:America north

Time:Monday, Nov 9 @ 08:00 - 11:30 (US/Eastern)

Organizers:Sandra Bae,Jürgen Bernard,Michael Correll,Mai Elshehaly,Takanori Fujiwara,Dan Keefe,Mahsan Nourani

Website:https://beliv-workshop.github.io/

Twenty years after the first BELIV in 2006, the BELIV workshop invites contributions on emerging and under-examined methodological challenges in visualization research, and fosters open discussions on how we establish the validity and scope of knowledge acquired in our domain, including all forms of systematic and empirical methods used to acquire this knowledge. The goal is to create space for members of the visualization research community to engage with a process of reflection and meta-discussion on empirical research practices in our domain, for example, on what level of rigor to require of our methods, how to choose methods and methodologies, and how to best communicate the results of empirical research. This year’s focus will be on two pressing concerns in visualization research: 1) building towards truth in the midst of growing challenges to validity such as the pressures of the replication crisis and the ubiquitous presence of AI-augmented data and analytics as well as 2) building towards ethical research in a world in turmoil while maintaining our integrity as researchers and individuals.

Papers

Are We All Archivists Now? Provenance Provocations for Information Visualization

Authors: Anamaria Crisan

Considering Contribution Statements in Visualization and HCI Research

Authors: Mara Solen, Wesley Willett, Andrew M McNutt

Epistemic Tensions: Reframing A Visualization Co-Design through Entanglement Theory

Authors: Wei Wei, Foroozan Daneshzand, Zezhong Wang, Erica Mattson, Jenny Farkas, Sarah Storteboom, Charles Perin, Sheelagh Carpendale

Facilitating Reproducibility in Visualization Systems Research Through Containerization

Authors: Thomas Breimer, Pirm Dhararag, Kiya Gedamu, Paras Pandey, Marie Amandine Reyes, Tal Spector, Galileo Steinberg, Nathan Subrahmanian, Paul Weir, Peter Williams, Weichen Zhao, Dylan Cashman

Guidelines Are Not Rules: Characterizing Terminologies around Visualization Design Guidelines

Authors: Anna L Chinni, Md Dilshadur Rahman, Bon Adriel Aseniero, Petra Isenberg, Kushin Mukherjee, Ghulam Jilani Quadri, Paul Rosen, Karen Schloss, Daniel Weiskopf

Marks, Channels, and Dead Ends: Stop Running Graphical Perception Studies and Start Modeling Visualizations as Images

Authors: Khairi Reda, Shambhawi Sharma, Luc Renambot, Fabio Miranda, Saeed Boorboor

Model Literacy: An Extra Summative Evaluation Factor for Visual Analytics

Authors: Lei Xia, Siyu Wu, Ye Sun, haodian li, Liang Zhou, Lei Shi

More Than 63% of IEEE VIS Research Liable to be Retracted?! Ethics Approval Statements Protect Participants (and Researchers!)

Authors: Lonni Besançon, Tobias Isenberg

Ten Things We Hate About Current IEEE VIS Reviewing Practices

Authors: Petra Isenberg, Sheelagh Carpendale

The Values of Visualization: Nurturing a Reflective Community of Practice with Critical Visualization Activities

Authors: Tatiana Losev, Fearn Bishop, Jason Dykes, Søren Knudsen, Doris Kosminsky, Isabel Meirelles, Jagoda Walny, Wesley Willett, Georgia Panagiotidou

Toward Visual Methods: Reflections on How Visuals Enrich Empirical Research

Authors: Zezhong Wang, Sheelagh Carpendale, Samuel Huron

Who Paid for It? Evaluating Reasoning Cost in AI-Mediated Visual Analytics

Authors: Aritra Dasgupta, Naga Datha Saikiran Battula

Why Question Answering Modality Matters in Visualization Studies and Tests

Authors: Anne-Flore Cabouat, Lily W. Ge, Tobias Isenberg, Samuel Huron, Matthew Kay, Petra Isenberg