Questionnaires are familiar. They are widely used in research, and they can make it possible to collect standardized information from many respondents. But that does not mean a questionnaire is automatically the right instrument for every study.
The more important question is:
Can a questionnaire collect the information I need to answer my research questions?
That is the question you should answer before you start writing your questionnaire.
Your research topic does not, by itself, determine your data collection instrument. Your research questions, objectives, the information you need, your participants and the nature of the study all matter.
So, how do you know whether a questionnaire is actually appropriate for your research?
Let’s break it down.
What Is a Questionnaire as a Data Collection Instrument?
A questionnaire is a structured set of questions or statements used to obtain information from respondents.
Depending on the purpose of the study, a questionnaire may contain different types of items, including:
- Closed-ended questions
- Multiple-choice questions
- Rating or Likert-scale items
- Open-ended questions
Closed-ended questions give respondents predetermined response options, making the resulting information easier to standardize and analyse. Open-ended questions allow respondents to answer in their own words and can provide additional detail, although those responses generally require more effort to code and analyse. (CDC)
For example, a researcher studying students’ satisfaction with an online learning platform might ask respondents to rate their level of satisfaction using a scale such as:
Very dissatisfied → Dissatisfied → Neutral → Satisfied → Very satisfied
But before creating questions like this, there is a more important issue to settle:
Is a questionnaire capable of giving you the information your research requires?
That is where your research questions come in.
The First Question to Ask: What Kind of Information Do You Need?
Before choosing a questionnaire, look at your research questions.
Ask yourself:
“What exactly do I need to find out from my participants?”
Suppose your study asks:
What is the level of social media usage among undergraduate students?
You may need information about:
- how frequently students use social media;
- which platforms they use;
- how much time they spend using them;
- what they use them for.
These are forms of information that can potentially be collected using structured questions.
Now consider a different research question:
How do undergraduate students describe their experiences of balancing social media use and academic responsibilities?
The researcher is now interested in detailed experiences and explanations.
A questionnaire might still be possible, particularly if it includes open-ended questions, but a method that allows participants to explain their experiences in greater depth may be more appropriate.
This gives you an important principle:
The information you need should influence how you collect it.
You should not begin with:
“What questions should I put in my questionnaire?”
Begin with:
“What information do I need to answer my research questions?”
Only then should you decide how best to obtain that information.
When Is a Questionnaire Usually a Good Choice?
A questionnaire may be appropriate when the information you need can be obtained effectively through respondents’ answers to standardized questions.
Here are some situations in which it may make sense.
You need standardized information from respondents
If you want every participant to respond to essentially the same set of questions, a questionnaire can provide a structured way of collecting comparable responses.
For example, if you want to determine students’ perceptions of a particular teaching method, you could present the same set of statements to all participants and ask them to indicate their level of agreement.
You need information about measurable characteristics, attitudes or perceptions
Questionnaires can be useful when your study requires information such as:
- attitudes;
- perceptions;
- satisfaction;
- reported practices;
- knowledge;
- frequency of activities; or
- other characteristics that respondents can reasonably report.
The key issue is not simply whether something is “measurable.”
It is whether the construct or information you are studying can be represented adequately through the questions and response options you provide.
You need responses from a relatively large group
A questionnaire can be useful when you need standardized information from many participants, particularly when the participants are geographically dispersed or when a self-administered format is practical.
However, “I have many respondents” is not enough reason to choose a questionnaire.
The questions must still be capable of collecting the information your study requires.
Your respondents can provide the information themselves
This is an important consideration.
Suppose you want to know how often students use a particular social media platform. The students themselves may be an appropriate source of that information.
But imagine that your research question is about what students actually do during a particular classroom activity. Simply asking students what they did may not provide the same kind of evidence as observing the activity.
So ask:
Are my respondents actually in a position to provide the information I need?
When a Questionnaire May NOT Be the Best Choice
Choosing a questionnaire simply because it is convenient can create problems later.
There are situations where another method may provide better evidence.
When you need detailed personal experiences
If the purpose of your study is to understand how people experienced something, why they interpreted it in a particular way, or how they explain their experiences, a method that allows detailed responses may be more suitable.
An interview, for example, can give participants more opportunity to explain their experiences in their own words.
When you need to observe actual behaviour
There is a difference between asking someone what they do and observing what they actually do.
If your research requires information about behaviours, activities or events as they occur, observation may be more appropriate.
When you need existing records or documents
Sometimes the information required already exists in:
- institutional records;
- documents;
- reports;
- archival materials;
- official databases; or
- other existing sources.
In such a case, asking participants to complete a questionnaire may not be the most direct way of obtaining the evidence.
When you need deeper exploration
Some research questions are exploratory and require participants to explain meanings, experiences, motivations or perspectives in considerable depth.
A structured questionnaire may restrict the range of responses you receive.
That does not mean questionnaires are incapable of collecting qualitative information. They can contain open-ended questions. However, the format may not provide the same depth or flexibility as methods specifically designed for detailed exploration.
So don’t choose a questionnaire because it is easy. Choose it because it fits the information your study needs.
Look at Your Research Questions Before Choosing
One of the easiest ways to make this decision is to work backwards from your research questions.
Take each research question and ask:
1. What exactly am I trying to find out?
Do not settle for a vague description.
Identify the actual information you need.
2. Who has the information I need?
Is it the students?
Teachers?
Patients?
Customers?
Employees?
An institution?
Or does the information already exist in documents or records?
3. How can I obtain that information?
Could the participants provide it by answering standardized questions?
Would they need to explain their experiences?
Would you need to observe something?
Would existing records provide better evidence?
4. Can respondents provide the information accurately through a questionnaire?
This question is often overlooked.
A questionnaire is not automatically suitable simply because respondents are available.
You also need to consider whether they can understand the questions, remember the information being requested and provide meaningful answers. Questionnaire design and administration can affect the quality of the data collected.
5. Would another method give me better information?
Do not be afraid of the answer.
If an interview, observation, document review or another method would answer your research question more effectively, then that method deserves consideration.
7. Check Your Research Objectives
Your research objectives are not merely statements you write in Chapter One and forget.
They can help you determine what data you need to collect.
Consider this objective:
To determine the level of customer satisfaction among users of a particular service.
A structured questionnaire could be appropriate because the researcher may want standardized responses that allow satisfaction to be measured and compared across participants.
Now consider:
To explore customers’ detailed experiences with the service.
The information required is different.
The researcher may need participants to explain what happened, how they interpreted their experiences and why they felt a particular way. A more open-ended method may therefore be appropriate.
The difference is subtle but important.
Your objectives tell you what your study intends to accomplish. Your data collection strategy should help you obtain the information needed to accomplish those objectives.
Consider Your Research Design
Your data collection instrument should also fit your broader research design.
You may encounter terms such as:
- quantitative research;
- qualitative research; and
- mixed-methods research.
But avoid making the common mistake of thinking:
Quantitative = questionnaire
Qualitative = interview
It is not that simple.
A quantitative study can use methods other than questionnaires, while qualitative research can involve methods other than interviews.
A questionnaire can also contain both closed-ended and open-ended questions.
The better approach is to ask:
What does my research design require me to find out, and what kind of evidence will allow me to answer my research questions?
Then select the method and instrument that fit that requirement.
Consider Your Respondents
Your respondents matter too.
Before deciding that a questionnaire is appropriate, consider:
- Who are your respondents?
- Can they understand the questions?
- Do they have the information being requested?
- Can they reasonably remember or report it?
- Is the questionnaire appropriate for their circumstances?
- Are the length and complexity manageable?
- Is the chosen mode of administration practical?
For example, a self-administered questionnaire assumes that participants can read, understand and follow the instructions and questions sufficiently well to provide meaningful responses. The design and delivery mode therefore need to take the characteristics of the study population into account.
This is why “I’ll just send them a Google Form” is not a methodology decision by itself.
The platform you use to administer a questionnaire is different from the methodological reasoning that justifies using a questionnaire in the first place.
Seven Questions to Ask Before Choosing a Questionnaire
Before committing to a questionnaire, ask yourself these seven questions:
1. What exactly am I trying to find out?
State the information clearly.
2. What type of data or information do I need?
Think about the actual responses required, rather than simply labelling the study “quantitative” or “qualitative.”
3. Can my respondents provide this information themselves?
Make sure your participants are an appropriate source of the information.
4. Can the information be captured effectively through questions?
Ask whether respondents can provide useful answers in the format you are planning to use.
5. Do my research questions and objectives support this choice?
Your instrument should serve the study—not exist separately from it.
6. Would another method give me better information?
Consider interviews, observation, document review, focus groups or other relevant methods.
7. Can I administer and manage the instrument properly?
Consider your respondents, access, timing, administration method, data quality and analysis.
If your answers consistently point toward a questionnaire, you now have a much stronger basis for choosing it.
A Practical Example: Choosing the Right Instrument
Consider this research topic:
Influence of Social Media Usage on Academic Performance Among Undergraduate Students
Suppose the research questions examine:
- the frequency of social media use among undergraduate students;
- the purposes for which they use social media;
- patterns of social media usage; and
- the perceived effects of social media use on their academic activities.
A structured questionnaire could be appropriate because the researcher needs standardized information from the students about these characteristics and perceptions.
The researcher could develop questions that correspond to the specific variables or constructs identified in the study.
Now change the research question to:
How do undergraduate students describe their personal experiences of balancing social media use and academic responsibilities?
That question is asking for something different.
The researcher may want detailed accounts of experiences, difficulties, interpretations and explanations.
An interview may therefore be considered if it would provide richer information for answering the question.
Notice what happened.
The topic did not change.
What changed was what the researcher wanted to find out.
That is why the research topic alone should not be used to choose your instrument.
The better sequence is:
Topic → research questions → objectives → information needed → appropriate method → appropriate instrument
Common Mistakes Students Make
Mistake 1: Choosing a questionnaire because everyone else is using one
Your classmate’s instrument does not automatically fit your study.
Two projects can have similar topics but different research questions and therefore require different approaches to data collection.
Mistake 2: Choosing the instrument before looking at the research questions
This reverses the process.
The research questions should help determine the information you need, and that should inform your choice of data collection method and instrument.
Mistake 3: Assuming every quantitative study must use a questionnaire
This is an oversimplification.
Quantitative research can involve different forms of data collection, depending on the study.
Mistake 4: Designing questions before determining what needs to be measured
This often produces a questionnaire containing interesting questions that do not actually help answer the research questions.
Before writing an item, ask:
Which research question or objective does this item help me address?
Mistake 5: Using a questionnaire when the research requires detailed explanations
If your study is asking participants to explain complex experiences or perspectives, consider whether a structured questionnaire will give you enough depth.
Mistake 6: Ignoring the characteristics of the respondents
A questionnaire must be understandable and workable for the people expected to complete it.
Mistake 7: Treating the questionnaire as the research method itself
This is where terminology can become confusing.
Think about the relationship between:
Research approach/design → data collection method → data collection instrument
The exact terminology varies across research traditions, but the important distinction is that your questionnaire is a tool used to collect information; it should be selected as part of a broader methodological decision.
When you reach the data collection stage, it is tempting to begin with:
“What questions should I put in my questionnaire?”
But that is not the first question you should ask.
The first question is:
“Is a questionnaire actually the best way to obtain the information my research needs?”
Your research questions tell you what you need to find out.
Your objectives tell you what your study intends to accomplish.
Your respondents determine who can provide the information.
Your research design provides the broader methodological framework.
And the nature of the information you need helps you determine how that information should be collected.
So don’t choose a questionnaire simply because it is familiar.
Don’t choose it because everyone else is using one.
And don’t choose it simply because it seems easier.
Choose it because it is appropriate for your study.
