Information Visualization Heuristics in Practical Expert Evaluation

Heli Väätäjä; Jari Varsaluoma; Tomi Heimonen; Katariina Tiitinen; Jaakko Hakulinen; Markku Turunen; Harri Nieminen; Petri Ihantola

doi:10.1145/2993901.2993918

Information Visualization Heuristics in Practical Expert Evaluation

Heli Väätäjä
, Jari Varsaluoma
, Tomi Heimonen
, Katariina Tiitinen
, Jaakko Hakulinen
, Markku Turunen
, Harri Nieminen
, Petri Ihantola

TAUCHI Research Center

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

16 Citations (Scopus)

Abstract

While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualization heuristics from prior research and their testing in practical heuristic evaluation. We found that the selected heuristics were useful with good coverage in our application case. However, based on our observations, we argue that interaction, veracity, and aesthetics related heuristics should be added to the previously used set. The lack of domain knowledge made the evaluators somewhat uneasy with their capability to carry out the investigation in-depth. We suggest to train domain experts with understanding of the data and application domain to carry out the evaluation to get insightful feedback beyond usability issues.

Original language	English
Title of host publication	BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization
Publisher	ACM
Pages	36-43
Number of pages	8
ISBN (Electronic)	978-1-4503-4818-8
DOIs	https://doi.org/10.1145/2993901.2993918
Publication status	Published - 2016
Publication type	A4 Article in conference proceedings
Event	International workshop on evaluation in visualization - Duration: 1 Jan 2016 → …

Conference

Conference	International workshop on evaluation in visualization
Period	1/01/16 → …

Keywords

Heuristics
InfoViz
description of a heuristic
domain knowledge
expert evaluation
explanatory quality
information visualization
tool
visual data analytics

Publication forum classification

Publication forum level 1

Access to Document

10.1145/2993901.2993918

Cite this

Väätäjä, H., Varsaluoma, J., Heimonen, T., Tiitinen, K., Hakulinen, J., Turunen, M., Nieminen, H., & Ihantola, P. (2016). Information Visualization Heuristics in Practical Expert Evaluation. In BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization (pp. 36-43). ACM. https://doi.org/10.1145/2993901.2993918

@inproceedings{36648b7d45f54b4987bf83fe612dc3ba,

title = "Information Visualization Heuristics in Practical Expert Evaluation",

abstract = "While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualization heuristics from prior research and their testing in practical heuristic evaluation. We found that the selected heuristics were useful with good coverage in our application case. However, based on our observations, we argue that interaction, veracity, and aesthetics related heuristics should be added to the previously used set. The lack of domain knowledge made the evaluators somewhat uneasy with their capability to carry out the investigation in-depth. We suggest to train domain experts with understanding of the data and application domain to carry out the evaluation to get insightful feedback beyond usability issues.",

keywords = "Heuristics, InfoViz, description of a heuristic, domain knowledge, expert evaluation, explanatory quality, information visualization, tool, visual data analytics, Heuristics, InfoViz, description of a heuristic, domain knowledge, expert evaluation, explanatory quality, information visualization, tool, visual data analytics",

author = "Heli V{\"a}{\"a}t{\"a}j{\"a} and Jari Varsaluoma and Tomi Heimonen and Katariina Tiitinen and Jaakko Hakulinen and Markku Turunen and Harri Nieminen and Petri Ihantola",

year = "2016",

doi = "10.1145/2993901.2993918",

language = "English",

pages = "36--43",

booktitle = "BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization",

publisher = "ACM",

address = "United States",

note = "International workshop on evaluation in visualization ; Conference date: 01-01-2016",

}

Väätäjä, H, Varsaluoma, J, Heimonen, T, Tiitinen, K, Hakulinen, J, Turunen, M, Nieminen, H & Ihantola, P 2016, Information Visualization Heuristics in Practical Expert Evaluation. in BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization. ACM, pp. 36-43, International workshop on evaluation in visualization, 1/01/16. https://doi.org/10.1145/2993901.2993918

Information Visualization Heuristics in Practical Expert Evaluation. / Väätäjä, Heli; Varsaluoma, Jari; Heimonen, Tomi et al.
BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization. ACM, 2016. p. 36-43.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Information Visualization Heuristics in Practical Expert Evaluation

AU - Väätäjä, Heli

AU - Varsaluoma, Jari

AU - Heimonen, Tomi

AU - Tiitinen, Katariina

AU - Hakulinen, Jaakko

AU - Turunen, Markku

AU - Nieminen, Harri

AU - Ihantola, Petri

PY - 2016

Y1 - 2016

N2 - While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualization heuristics from prior research and their testing in practical heuristic evaluation. We found that the selected heuristics were useful with good coverage in our application case. However, based on our observations, we argue that interaction, veracity, and aesthetics related heuristics should be added to the previously used set. The lack of domain knowledge made the evaluators somewhat uneasy with their capability to carry out the investigation in-depth. We suggest to train domain experts with understanding of the data and application domain to carry out the evaluation to get insightful feedback beyond usability issues.

AB - While traditional HCI heuristics can be used to find usability issues also from information visualization systems, specialized heuristics tailored for the information visualization (InfoViz) domain can be more effective and focus on the special characteristics of these systems. In this study, we describe the application of ten information visualization heuristics from prior research and their testing in practical heuristic evaluation. We found that the selected heuristics were useful with good coverage in our application case. However, based on our observations, we argue that interaction, veracity, and aesthetics related heuristics should be added to the previously used set. The lack of domain knowledge made the evaluators somewhat uneasy with their capability to carry out the investigation in-depth. We suggest to train domain experts with understanding of the data and application domain to carry out the evaluation to get insightful feedback beyond usability issues.

KW - Heuristics

KW - InfoViz

KW - description of a heuristic

KW - domain knowledge

KW - expert evaluation

KW - explanatory quality

KW - information visualization

KW - tool

KW - visual data analytics

KW - Heuristics

KW - InfoViz

KW - description of a heuristic

KW - domain knowledge

KW - expert evaluation

KW - explanatory quality

KW - information visualization

KW - tool

KW - visual data analytics

U2 - 10.1145/2993901.2993918

DO - 10.1145/2993901.2993918

M3 - Conference contribution

SP - 36

EP - 43

BT - BELIV '16 Proceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization

PB - ACM

T2 - International workshop on evaluation in visualization

Y2 - 1 January 2016

ER -

Information Visualization Heuristics in Practical Expert Evaluation

Abstract

Conference

Keywords

Publication forum classification

Access to Document

Fingerprint

Cite this