Computer Graphics

University of California - Berkeley

Perceptual Interpretation of Ink Annotations on Line Charts


Asynchronous collaborators often use freeform ink annotations to point to visually salient perceptual features of line charts such as peaks or humps, valleys, rising slopes and declining slopes. We present a set of techniques for interpreting such annotations to algorithmically identify the corresponding perceptual parts. Our approach is to first apply a parts-based segmentation algorithm that identifies the visually salient perceptual parts in the chart. Our system then analyzes the freeform annotations to infer the corresponding peaks, valleys or sloping segments. Once the system has identified the perceptual parts it can highlight them to draw further attention and reduce ambiguity of interpretation in asynchronous collaborative discussions.


Nicholas Kong and Maneesh Agrawala. "Perceptual Interpretation of Ink Annotations on Line Charts". UIST 2009, pages 233–236, 2009.

Supplemental Material

For further details, including videos and supplmental materials, please see the project page hosted on the Visualization Lab website at