Estimating The Robustness Of Questionnaire Results: Lessons From A Mixed-Mode Survey Of Expectations For Tele-Working And Road-Based Business Travel

In the course of a larger project that sought to explore the impacts of the increasing availability of information and communication technologies (ICT) on travel demand, the authors encountered a number of methodological issues that provide useful insights into alternative approaches to the collection of behavioral data and preferences. The current study explores the robustness of questionnaire results to various forms of bias in the context of a dual-mode (web and hardcopy) survey. The survey investigated employers? anticipations of levels of employee commuting and business travel activity under a range of future ICT scenarios. The questionnaire incorporated several innovative features which, together with the dual-mode format, allowed an unusually wide range of analyses. The robustness of respondents? opinions was tested by examining the effect of incorporating alternative versions of a briefing text, one being very positive and one very negative, about the role of ICT. Instrument bias was identified via detailed comparison of the results from the two versions of the questionnaire. The impact of exogenous factors which are often ignored or taken as constant was assessed via special supplementary questions. Analysis showed that the robustness of opinions and expectations varied and was influenced by respondent characteristics, and that results from the two versions of the questionnaire differed significantly. Results indicate that opinions and expectations are less robust, and questionnaire results are more subject to bias and myopic interpretation, than is generally recognized and that web-based surveys seem particularly vulnerable to sampling bias. Methods are suggested for measuring robustness, for reducing bias and for validating and contextualizing results.

• Record URL:
  • https://doi.org/10.1007/s11116-008-9185-5
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/00494488
• Authors:
  • Bonsall, Peter
  • Shires, Jeremy
• Publication Date: 2009-1

Language

• English

Media Info

• Media Type: Print
• Features: References; Tables;
• Pagination: pp 47-64
• Serial:
  • Transportation
  • Volume: 36
  • Issue Number: 1
  • Publisher: Springer
  • ISSN: 0049-4488
  • EISSN: 1572-9435
  • Serial URL: http://link.springer.com/journal/11116

Subject/Index Terms

• TRT Terms: Business trips; Communications; Data collection; Information technology; Methodology; Questionnaires; Telecommuting; Travel behavior; Travel demand
• Uncontrolled Terms: Robustness
• Subject Areas: Highways; Planning and Forecasting; I72: Traffic and Transport Planning;

Filing Info

• Accession Number: 01127266
• Record Type: Publication
• Files: TRIS
• Created Date: Apr 28 2009 8:10AM