Designing Effective Online Surveys

A 4-Day Livestream Seminar Taught by Andrew Miles, Ph.D.

Download Sample Course Slides

The Internet has revolutionized survey research. Web-based surveys are now used in many disciplines, and for good reason. Compared to traditional paper-and-pencil and face-to-face modes of data collection, they make it easy to randomize question order, skip irrelevant questions, include rich multimedia content, and adapt the survey experience based on respondent input. Add to this a wide range of question types and unparalleled ease of distribution, and it is easy to see why web-based surveys have become so popular.

But the Internet doesn’t just make it easy to program surveys: it also gives unparalleled access to a vast reservoir of potential research participants. With the help of third-party web panels or crowdsourcing websites, researchers can recruit respondents and complete data collection in a matter of days, sometimes hours. Fielding surveys online is also inexpensive, which makes it possible to obtain large samples even for researchers on a budget.

Online surveys are not a panacea, however. Web-based surveys make use of digital technologies that differ in marked ways from other survey modes, raising the question of how the mode of data collection influences results. Web surveys also can also be completed on both computers and mobile devices, a fact which comes with its own set of possibilities and pitfalls. And respondents recruited online are generally far from representative of most populations of interest.

This course provides a practical introduction to designing effective web surveys and working with online respondents. Particular attention is given to how choices made at the questionnaire-writing and web-design stages affect response rates and data quality, with an emphasis on highlighting actionable design strategies. We also delve deeply into the advantages and disadvantages of using online samples and evaluate design-based and post-hoc approaches to addressing some of the challenges associated with online research.

Starting August 9, we are offering this seminar as a 4-day synchronous*, livestream workshop held via the free video-conferencing software Zoom. Each day will consist of two lecture sessions which include hands-on exercises, separated by a 1-hour break. Participants are encouraged to join the lecture live, but will have the opportunity to view the recorded session later in the day if they are unable to attend at the scheduled time 

*We understand that scheduling is difficult during this unpredictable time. If you prefer, you may take all or part of the course asynchronously. The video recordings will be made available within 24 hours of each session and will be accessible for four weeks after the seminar, meaning that you will get all of the class content and discussions even if you cannot participate synchronously. Please note that this course contains several small group discussions that cannot be joined asynchronously. We will be able to record one of the sessions, but not all simultaneously. The instructor will provide all relevant materials so that asynchronous participants can review them on their own.

Closed captioning is available for all live and recorded sessions.

More Details About the Course Content

This course presents the latest research on designing web-surveys and working with online respondents. We first address the fundamentals of writing effective survey questions, which is the core of any survey, web-based or otherwise. We then turn to various design issues with an eye toward maximizing response rates and data quality. Topics include determining optimal survey length, adapting for mobile devices, reducing respondent fatigue, creating effective visual layouts, and pre-testing. We then discuss online samples: when to use them, how to recruit them, how to manage them effectively. Class meetings will consist of lectures interspersed with demonstrations of key ideas. Participants will be given the opportunity to apply the principles and skills through take-home exercises.

Computing

This course uses Qualtrics survey software. However, the principles discussed can be applied in many web-survey software packages, so participants who use a package other than Qualtrics will still benefit. Alternately, those without a Qualtrics subscription can use the free version of Qualtrics, which allows access to a number of important design capabilities. Please note that while this class uses Qualtrics, it is not a class about Qualtrics—that is, the focus will be on survey design, not on familiarizing participants with the full capabilities of Qualtrics.

Who Should Register?

This course is suitable for anyone who wants an up-to-date understanding of best practices in web survey design and working with online respondents. Course content will be valuable for both novices and seasoned researchers who have limited experience collecting data online.

Outline

  • Designing effective web-based surveys
    • Survey length
    • Writing the questionnaire
      • Writing (or finding) effective questions
      • Writing complete questionnaires
    • Programming the survey
      • Survey flow
      • Visual design
      • Interactive features
    • Mobile devices
    • Pre-testing surveys

Reviews of Designing Effective Online Surveys

“Highly recommend this comprehensive course for graduate students who are going to use or create surveys for data collection. The course content was very relevant and helped me improve my overall survey design. Thank you!” 
  Nancy Connor, Queen’s University 

“I found the course interesting to follow. Although it was online, it was interactive enough to keep the attention high, and I also liked the teacher. I enjoyed the breakout session in smaller groups as well.” 
  Elise Braekman, Sciensano 

“The instructor’s superb presentation and handling of questions was top notch – sharp, knowledgeable, to the point.”  
  Anar Ahmadov, Leiden University 

Seminar information

Tuesday, August 9, 2022 –
Friday, August 12, 2022

Each day will follow this schedule:

10:30am-12:30pm ET (New York time): Live session via Zoom

1:30pm-3:00pm ET: Live session via Zoom

Payment Information

The fee of $895 includes all course materials.

PayPal and all major credit cards are accepted.

Our Tax ID number is 26-4576270.