EVALUATING THE PERFORMANCE OF A SIMULATION MODEL
A framework is described for the examination of mathematical models, where model calibration and evaluation is based on the ability of a model to generate a set of observed outputs from a supplied set of observed inputs. With refinement and development, the framework may lead to general structures for the more rigorous evaluation of models. An application of the proposed framework to a local area traffic assignment model is described. The application facilitates the description of the framework and some of its technical components. The traffic model was tested with peak period traffic data collected in an inner suburban area of Melbourne, Australia, during 1974. On the basis of the tests conducted, this model seems a potentially useful tool for use in small-area traffic analysis. The suggested evaluation framework has its roots in previous work in the areas of transportation, hydrology and mathematical statistics. A series of levels for model evaluation are defined. For models calibrated on their ability to reproduce observed phenomena, conclusions about model usefulness and applicability need to be made with some caution. It is necessary to investigate goodness-of-fit of model outputs, and the robustness of parameter estimates, with data independent of that on which the model was calibrated. A possible scheme, known as "dual-sample testing", for this investigation is outlined. A number of possible tests of model outputs and possible systematic errors are also discussed. (a) (TRRL)
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/issn/09658564
-
Corporate Authors:
Pergamon Press, Incorporated
Headington Hill Hall
Oxford OX30BW, -
Authors:
- TAYLOR, MAP
- Publication Date: 1979-6
Media Info
- Features: Figures; References; Tables;
- Pagination: p. 159-173
-
Serial:
- Transportation Research Part A: Policy and Practice
- Volume: 13A
- Issue Number: 3
- Publisher: Elsevier
- ISSN: 0965-8564
- Serial URL: http://www.sciencedirect.com/science/journal/09658564
Subject/Index Terms
- TRT Terms: Economic efficiency; Evaluation; Evaluation and assessment; Mathematical models; Peak periods; Regression analysis; Simulation; Test procedures; Traffic surveys; Transportation
- Uncontrolled Terms: Efficiency; Traffic studies; Transportation models
- Geographic Terms: Australia
- ITRD Terms: 8006: Australia; 5911: Efficiency; 9020: Evaluation (assessment); 6473: Mathematical model; 6588: Regression analysis; 9103: Simulation; 6288: Test method; 676: Traffic survey; 1155: Transport
- Subject Areas: Operations and Traffic Management; Transportation (General); I71: Traffic Theory;
Filing Info
- Accession Number: 00310409
- Record Type: Publication
- Source Agency: Transport Research Laboratory
- Report/Paper Numbers: SERIAL
- Files: ITRD, TRIS, ATRI
- Created Date: Jun 26 1980 12:00AM