The predictive value and the reliability of evaluations made in immersive projection environments are limited when compared to the real world. As in other applications of numerical simulations, the acceptance of such techniques does not only depend on the stability of the methods, but also on the quality and credibility of the results obtained. In this paper, we investigate the predictive value of virtual reality and virtual environments when used for engineering assessment tasks. We examine the ergonomics evaluation of a vehicle interior, which is a complex activity relying heavily on know-how gained from personal experience, and compare performance in a VE with performance in the real world. If one assumes that within complex engineering processes certain types of work will be performed by more or less the same personnel, one can infer that a fairly consistent base of experience-based knowledge exists. Under such premises and if evaluations are conducted as comparisons within the VE, we believe that the reliability of the assessments is suitable for conceptual design work. Despite a number of unanswered questions at this time we believe this study leads to a better understanding of what determines the reliability of results obtained in virtual environments, thus making it useful for optimizing virtual prototyping processes and better utilization of the potential of VR and VEs in company work processes.

1.
Baitch, L., and Smith, R. C., 2000, “Physiological Correlates of Spatial Perceptual Discordance in a Virtual Environment,” Proc. Fourth International Projection Technology Workshop, Ames, Iowa.
2.
Bo¨hle, F., and Rose, H., 1992, “Technik und Erfahrung, Arbeit in hochautomatisierten Systemen,” Institut fu¨r Sozialwissenschaftliche Forschung (ISF), Campus Verlag, Mu¨nchen.
3.
Jayaram, S., et al., 1999, “A Virtual Assembly Design Environment,” Proc. IEEE Virtual Reality, Houston, USA, pp. 172–179.
4.
Kallmann, M., and Thalmann, D., 1999, “Direct 3D Interaction with Smart Objects,” Proc. ACM Symposium on Virtual Reality Software and Technology, London, UK, pp. 124–130.
5.
Reuding, T., 2000, “Beyond Academic Exercises,- Strategies Towards a Profitable Implementation of VR Technology in Company Work Processes,” J. D. Mulder and R. van Liere (eds) Virtual Environments 2000, Springer Verlag, Wien, pp. 197–205.
6.
Riedel, O., Breining, R., and Scharm, H., 1997, “How to use Virtual Environments for Engineering Projects,” Proc. ACM Siggraph’97, ACM Press, New York.
7.
Schulz
,
M.
,
Reuding
,
T.
, and
Ertl
,
T.
,
1998
, “
Analyzing Engineering Simulations in a Virtual Environment
,”
IEEE Comput. Graphics Appl.
,
18
(
6
), pp.
46
52
.
8.
Bowman, D. A., Johnson, D. B., and Hodges, L. F., 1999, “Testbed Evaluation of Virtual Environment Interaction Techniques,” Proc. ACM Symposium on Virtual Reality Software and Technology, London, UK, pp. 26–33.
9.
Lindeman, R. W., Sibert, J. L., and Hahn, J. K., 1999, “Hand-Held Windows: Towards Effective 2D Interaction in Immersive Virtual Environments,” Proc. IEEE Virtual Reality, Houston, USA, pp. 205–212.
10.
Neumann, U., and Majoros, A., 1998, “Cognitive Performance and System Issues for Augmented Reality Applications in Manufacturing and Maintenance,” Proc. IEEE Virtual Reality Annual International Symposium, Atlanta, USA, pp. 4–11.
11.
Poupyrev, I., 1997, http://www.hitl.washington.edu/research/metaphors/vrmat.html
12.
Sutcliffe
,
A. G.
, and
Deol Kaur
,
K.
,
2000
, “
Evaluating the Usability of Virtual Reality User Interfaces
,”
Behavior & Information Technology
,
19
(
6
), pp.
415
426
.
13.
Kawara
,
T.
,
Ohmi
,
M.
, and
Yoshizawa
,
T.
,
1996
, “
Effects on Visual Functions During Tasks of Object Handling in Virtual Environment with a Head Mounted Display
,”
Ergonomics
,
39
(
11
), pp.
1370
1380
.
14.
Miyao
,
M.
et al.
,
1996
, “
Visual Accommodation and Subject Performance During a Stereographic Object Task Using Liquid Crystal Shutters
,”
Ergonomics
,
39
(
11
), pp.
1294
1309
.
15.
Watson, B., et al., 1997, “Evaluation of the Effects of Frame Time Variation on VR Task Performance,” Proc. IEEE Virtual Reality Annual International Symposium, Albuquerque, USA.
16.
Scapin
,
D. L.
, and
Berns
,
T.
,
1997
, “
Usability Evaluation Methods
,”
Behavior & Information Technology
,
16
(
4/5
), pp.
185
185
.
17.
De Vries
,
G.
, and
Johnson
,
G. I.
,
1997
, “
Spoken Help for a Car Stereo: An Exploratory Study
,”
Behavior & Information Technology
,
16
(
2
), pp.
79
87
.
18.
RAMSIS, 2001, http://www.hs.tecmath.de/english/ramsis_eng.shtml
19.
Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A., 1993, “Surround-screen Projection-based Virtual Reality: The Design and Implementation of the CAVE,” Proc. ACM Siggraph’93, ACM Press, New York.
20.
Blach, R., Landauer, J., Ro¨sch, J., and Simon, A., 1998, “A Flexible Prototyping Tool for 3D Real-Time User-Interaction,” M. Landauer and M. Go¨bel (eds) Virtual Environments ’98, Springer Verlag, Wien, pp. 195–203.
You do not currently have access to this content.