CORTEXA
← Browse
arxivcs.HC2026-07-17

Interactive Mascot: A Scene-Centric Interaction Grammar for Data Visualizations

Zhicheng Liu

Scene-centric visualization systems expose semantic components, such as marks, encodings, layouts, and axes, as first-class objects that can be directly manipulated. Existing interaction abstractions, however, are largely based on event streams, signals, and data selections rather than semantic scene components. This mismatch makes interactions involving scene components less natural to specify and limits the expressive power of scene-centric visualization systems. We present Interactive Mascot, a scene-centric interaction grammar for data visualizations. Interactive Mascot extends scene-centric representations for static visualizations by modeling interactive behavior as information flow among four interaction components (trigger, responder, evaluator, and updater) and two forms of context (event context and state context). To realize these semantics, we introduce a dependency-graph execution model that systematically transforms interaction specifications into executable dependency graphs using reusable graph patterns associated with semantic visualization components. We implement Interactive Mascot in the JavaScript library Mascot$.$js and evaluate its expressiveness, performance, and usability. Interactive Mascot naturally covers Vega-Lite's interaction design space while additionally supporting stateful interactions, direct manipulation of scene components, and freeform selection. It achieves runtime performance comparable to Vega-Lite, and a qualitative user study shows that the grammar is learnable and usable for interaction authoring.

View free PDFSource page

Related papers

arxivcs.HC2026-07-23

Charting the Moral Universe: Capturing Virtues and Values of Data Visualization Practice

Chloe Hudson Prock, Enrico Bertini, Michael Correll

What do we value in our visualizations, and in the people who design them? Despite a growing body of work on critical data visualization, the conception of what it is to do ethical data visualization work can often be narrow (for instance, holding that our ethical duties are disc…

View free PDFSource page
arxivcs.HCcs.CV2026-07-16

Skeleton: Visual Authoring of Non-visual Data Experiences

Frank Elavsky, Chieri Nnadozie, Lucas Nadolskis, Patrick Carrington, Dominik Moritz

When sighted practitioners author accessible data visualizations, they build navigation structures (the nodes, edges, and input bindings that govern how assistive technologies traverse an interface) entirely in code, with no visual representation. Without a representation to reac…

View free PDFSource page
arxivcs.CVcs.HC2026-07-22

MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction

Yue Zhao, Hongxu Liu, Feiyu Wang, Xiaoyu Yang, Tong Ge, Zhen Yang, et al.

Multimodal large language models (MLLMs) are increasingly expected to automate visualization development by generating code directly from visual designs. However, existing evaluations mainly focus on single-chart generation and overlook coordinated multi-view interface constructi…

View free PDFSource page
arxivcs.HCcs.PL2026-07-22

Flint: A Semantics-Driven Data Visualization Intermediate Language

Yunhai Wang, Kecheng Lu, Junhao Chen, Alper Sarikaya, Chenglong Wang

We present Flint, an intermediate language that enables authors to create high-quality visualizations from concise, semantics-driven specifications without explicitly configuring low-level parameters such as scales, axes, and formatting. Unlike prior systems that infer default co…

View free PDFSource page
arxivcs.HC2026-07-31

Data Visualization Style Guides in Practice: Why They Emerge, How They Work, and When They Bend

Alvitta Ottley, Jonathan Schwabish

Visualization style guides play a crucial role in shaping how data is interpreted and trusted, yet they often receive little scrutiny in their creation and use. Understanding their impact requires looking beyond the specific rules that style guides prescribe and examining how the…

View free PDFSource page