Indiana University School of Informatics Indiana University Bloomington

Sean Ellis' HCI Capstone Thesis Project:
A Collaborative Annotation System for Data Visualization

The focus of this project is to explore the area of digitally annotating information visualizations, and sharing the visualizations and annotations between colleagues. In this research we describe a collaborative visualization environment, in which users can simultaneously view a common, shared visualization.


Resources being considered for Bibliography

Annotation Systems

    DISCIPLE (business, healthcare, military, trasnportation focus)
  • Collaboration Using Heterogeneous Devices From 3D Workstations to PDA's
    Introduces a system for rendering images between computers with very different display sizes (3D workstations to PDA's). Discusses the importance of doing so, as smaller and larger screens are being developed at a rapid pace.
  • DISCIPLE: A Framework for Multimodal Collaboration in Heterogeneous Environments
  • DISCIPLE Home Page 'The key objective of the DISCIPLE project has been to develop an advanced groupware design that enables interactive collaboration in the context of the task at hand. The participants at different locations collaboratively access, manipulate, analyze, and evaluate multimedia data. They may have different preferences for data presentation and system interaction and may use unlike computing devices and communication technologies. The system uses intelligent knowledge-based strategies to reduce the effect of differences and thus provide for equitable and effective collaboration.'
  • Annotations in Amaya
    Users can annotate web documents (text). Annotations are represented with a pencil icon; a double click on a pencil reveals the annotation text in a new window. Annotations can be seen by anyone with the right access.
  • Demonstrating the Electronic Napkin
    A tool aimed at supporting multi-user coceptual design. Uses recognition to compare marks made to the surface with marks in a database. Users can store and retreive drawings.
    MUMMY: Mobile Knowledge Management
  • High level overview of MUMMY project, en EU funded effort. Uses pocket-sized and mobile computers. References annotation of images and video.
  • DS GeneAtlas
    DS GeneAtlas™ is an automated protein annotation pipeline for analyzing protein sequences and identifying their biochemical function in the DS Modeling environment. The pipeline incorporates methods such as PSI-BLAST, high throughput modeling, fold recognition, and 3D annotation.
Systems that support Collaboration and Annotation

  • Boom Chameleon: Simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display.
    PDF
    MPEG
    Protein Visualization
  • A Collaborative Environment for Protein Visualization
    Collaboration and annotation of 3D protein data. Built for desktop PC's. Supports multiple user interaction; peer-peer and master-slave modes. Sticky notes are a form of annotation. There are 'information container' notes, and action notes that run other programs when envoked.
  • A Distributed Protein A Distributed Protein Visualization Application
    Uses 'sticky notes' as a way to signify annotations to visualizations. There are 3 types of sticky notes: Text, audio and action. Action notes store parts of programs that may be envoked by the user. There are also active notes which are similar to action notes except that users can specify conditions before envoking a program; they can also be envoked automatically. This system only supports collaboration and annotation in the bio-informatics arena; it is not a general solution, but a specific solution to a specific problem.
  • A Prototype Molecular Interactive Collaborative Environment (MICE)

  • CEV: Collaborative Environment for Visualization Using Java RMI (98)
    Collaboration is done through standard web browsers. "Each researcher has a local (or private) view, a global (or public) view, and a list of the current participants' session name. The session name, specified by a parameter within the html used to load the applet, represents each individual participant." Client-Server model alleviates clients from having to process large graphics files. Does not support, "audio/video conferencing system, a session manager that records the session and stores it into a database, and a rigid authentication process."
  • IRIS Annotator
    After annotating an image, the annotator can send an email to a recipient telling him to view the annotation. Can view, and annotate 3D graphics. Requires SGI® workstation, IRIX operating system, version 5.3 and Netscape browser. "You can easily specify an automatic playback sequence for the markers and for the attached notes This is particularly useful when the information being communicated is best presented in a linear fashion. For random play, first select a marker either by picking it from the scene or from a list. The marker label and its media notes are then displayed alongside the marker, and can be selected and played individually. For automatic play, use the simple VCR-like button controls
  • I3D: An Interactive System for Exploring Annotated 3D Environments
    Claims that the best interactive system for exploring 3D environments should include:
    • interactive 3D viewing capabilities
    • time-critical rendering
    • multiple kinds of annotations
    • distribution and sharing
    I3D runs on Silicon Graphics workstations and was implemented on top of X11/OpenGL. Uses a mouse and a spaceball for input devices. Annotations are drawn with a blue silhouette. "Selecting an annotated geometry by clicking on its visual representation with the mouse triggers the document retrieval and display.
    Marching Cubes
  • Marching Cubes
    The MarchingCubes for Windows software displays Fourier Electron Density Contour Maps in 3D; allowing the user to rotate, translate, zoom and manipulate the Fourier Map for analysis, and output to publications and posters. It also allows manually peak picking and 3D display if you have 3D gaming goggles

CSCW

Collaboration

  • Collaborating Across the Miles
    This work is about the DOE 2000 (Department of Energy), and their efforts to create technology that allows for collaboration between remote users. It reviews the state of the art in collaborating remotely. Looks at Video Conferencing, NetMeeting, and VNC. Does not give an example of a system that uses handwritting style annotation. Does mention that the
Digital Video Annotation

Digital Document Annotation

Research

    Computer Supported Collaborative Visualization
  • Re-Integrating the Research Record
  • CSCV - Computer Supported Collaborative Visualization (95)
    Overview of the field of CSCV. Identifies a major problem in the three big collaborative scientific systems, (IRIS, IBM Data Explorer, AVS) none of them support remote collaboration. In order to collaborate users must cluster around the same computer. This work also extends the Haber & McNabb pipeline, "They describe the visualization in terms of its component processes, which they categorise as filter, map and render stages."
  • Scientific Visualization - Some Novel Approaches to Learning
    Identifies a problem with the IRIS Annotator: visualizations can only be viewed on one screen at a time; in order to collaborate users must cluster around one workstation. These researchers developed modules which support collaborative uses of IRIS by different people, in different locations. Data visualizations images are rendered using VRML and displayed through either Mosiac or Netscape browsers. Not clear if this system supports annotation.
  • A Comparison of Reading Paper and On-Line Documents
    Readers feel more comfortable reading paper docs, than online docs. Annotation's can be made in the margins of paper; annotating paper documents is natural. It is more natural, quick, and easy for us to read paper documents. We do not have tools that support paper like online reading, while also supporting free form annotation
  • The Future of Annotation in a Digital (Paper) World
    Accounts different usages of annotations. Good overview of annotation in general.
    Paper Annotation
    Marshall
  • Annotation: from paper books to the digital library
    Studied many university textbooks to note the differences/similarities of annotations made to the texts. Annotations are informal and used for a variety of reasons (procedural signals, placemarkers and aids to memory, in situ locations for problem-working, a record of interpretive activity, a visible trace of the reader's attention, incidental reflections of the material.) Can systems support the same informal, quick type of annotation that paper supports?
  • From Personal to Shared Annotations
    This paper analyzes the annotations made during a graduate level CS course. They use WebAnn as the online annotation tool. She finds that students make much more personal annotations than they do public annotations. This may be that people feel more comfortable making annotations in private, or that people don't like to annotate on the computer as much as paper. Either way, this evidence suggests that tools such as WebAnn are not great at supporting quality online collaboration and annotation.