What factors are involved in qualitative?

How does a client, an end-user, or buyer evaluate the quality of our qualitative research?  How does this person know with any degree of confidence that the qualitative end-product is legitimately useful?  We conduct the interviews and observations, deliver audio, video, and written analysis of our findings filled with implications and next

What factors are involved in qualitative?
steps, but how does anyone judge its efficacy as a piece of qualitative research?

We don’t seem to have this problem in survey research.  The countless discussions and experiments conducted on various aspects of survey design give ongoing support for a “quality framework” by which providers and users can gauge research results.  To this end, quantitative researchers often talk about “total survey error” and “fitness for use” referring to the variety of potential errors and “dimensions” that impact the survey quality framework.  By highlighting these errors, both researcher and end-user more fully appreciate research outcomes and understand what they have (or don’t have).  They understand, for instance, how the accuracy or projectable component of their research may have been sacrificed due to insurmountable budget or schedule constraints.

A quality framework is lacking in qualitative research.  Beyond the basic dos and don’ts, there are no tested dimensions we can use to compare one qualitative study from another.  While research-on-research is critical to improving the quality of what we do, the qualitative marketing research world has been blatantly absent from the investigative scene.  In their 2001 paper (“Why We Need to Reassess Focus Group Research”), Catterall and Clarke discuss the work that has been done in focus group research to better understand the effect of variables such as: the inclusion of professional participants, the presence of observers, and interviewer (moderator) effects.  Yet much of this work is done outside the practitioner arena and industry-wide discussions (dare I say, experimentation) on these and similar issues are, for all intents and purposes, nonexistent.

Back in 1944, Edwards Deming developed a classification of potential error in survey research, identifying 13 “factors affecting the ultimate usefulness of a survey.” These factors include “variability in response,” “bias and variation arising from the interviewer,” “imperfections in the design of the questionnaire,” among others.

So, where is our list of factors impacting the quality of qualitative research allowing us to judge the usefulness of our efforts?  One such classification scheme looks like this:

13 Factors Impacting the Quality of Qualitative Research

The Environment

Potential variability associated with the:

  • Particular venue/setting (incl., face-to-face and online)
  • Presence of observers/interviewers as well as other participants (e.g., groups vs. IDIs)
  • Audio & video recording

The Dynamics

Potential variability associated with:

  • Professional participants (“cheaters”)
  • Participants’ cultural/social/economic/gender/age diversity
  • Cognitive processes/constructs
  • Geographic/regional differences
  • Dominators, group vs. individual think

The Interviewer/Moderator

Potential variability associated with the:

  • Personal/personality aspects of the interviewer/moderator
  • “Best” techniques utilized for specific topics, type of participants, venue
  • Question formatting
  • Question sequencing
  • Use of projective techniques (e.g., what to use when, impact on the discussion overall, analytical schemes)

Catterall, M., & Clarke, W. (2001). Why we need to reassess focus group research. ACR Asia-Pacific Advances.

Qualitative research involves observations and conversations. In most of the cases, there is a direct interaction between the respondents and the researchers. For example, if you want to know why less women are visiting your store compared to men, or why more people click the orange button on your landing page than the blue button, you may need to carry out qualitative research.

Just as in any research project, the success of your qualitative research project rests on certain approaches, tactics and methods. Six of such approaches and techniques are described below.

1. Choosing an appropriate methodology

There are different ways you can gather qualitative information from your respondents. Every method is important but what method you choose depends on the type of information that you need.

Should it be one-to-one, in-depth interview? Should it be focus groups? Do people need to be physically present at the place where the interaction is happening, or can they respond through the Internet?

If you plan to conduct brainstorming sessions, it’s better to do them among focus groups of 6-10 people facilitated by a moderator or a researcher.

If you need individual input, it is better to have one-on-one interviews.

2. Selecting the right respondents or participants

The quality of the data that you gather depends a lot on the participants. If you want your participants to try out your new mobile phone model, it doesn’t make sense to invite those who are not interested in trying out new gadgets.

Similarly, there is no use brainstorming with a focus group about the new automobile model you are working on in which people either don’t have the purchasing power for that model or are simply not interested in using private automobiles.

Hence, selecting the right respondents or participants is as equally important as using the right method for your qualitative research.

3. Training your interviewers and moderators

Although in an established research company, the interviewers and moderators are quite familiar with different aspects of doing research and gathering data, every research project is unique and hence, initial briefing is required to educate interviewers and moderators. It should be clearly communicated to them what information to seek and what prompts to provide to the respondents. They must also be told about the various body language and facial expressions to take note of while interacting with the respondents.

Find out how our market research can help your business grow

4. Data recording and transcripting

While the interactions and interviews are going on, a consistent way of noting down the observations and responses must be decided. Unless a consistent format is followed, it will be difficult to use software and interpretation tools to process the data in a meaningful manner.

For example, in some interviews, the input must be recorded verbatim using a predesigned form or a video/audio recorder. Sometimes on the other hand, interpretations can be made based on observations and since observations can vary from respondent to respondent, it must be decided beforehand how these variations will be recorded so that they can be analysed later while keeping the integrity of the data intact.

5. Reading qualitative research transcripts

Once all the designated interviews and interactive sessions have been done, the researchers will have the collection of transcripts with them. Remember that there are many non-verbal cues during the qualitative research that cannot be written verbatim. Only trained researchers can interpret such transcripts and read between the lines instead of trying to make sense of individual words and phrases. A trained eye is needed to read qualitative research transcripts.

6. Analysis of the data

The purpose of analysis is to get you honest, real feedback in response to the questions asked and the queries made about of fresh product or service you have just introduced. Alternately, you are looking to build a body of statistical research around an idea or concept.

You also need analysis of data for decision-making. Statistical practices are used to organise, refine, evaluate and interpret the information that is gathered, based on the purpose of the study or research.

What factors are involved in qualitative research?

6 Critical Success Factors of a Qualitative Research Project.
Using the Right Methodology. ... .
Talking To the Right Person. ... .
Briefing Interviewers & Moderators. ... .
Note Taking or Transcripts. ... .
Reading Transcripts. ... .
Qualitative Analysis..

What are the factors qualitative or quantitative?

Generally speaking, quantitative analysis involves looking at the hard data, the actual numbers. Qualitative analysis is less tangible. It concerns subjective characteristics and opinions – things that cannot be expressed as a number. Here's a closer look at aspects of both and how they are used.

What is qualitative factor analysis?

What Is Qualitative Analysis? In business and management, qualitative analysis uses subjective judgment to analyze a company's value or prospects based on non-quantifiable information, such as management expertise, industry cycles, strength of research and development, and labor relations.

What are the 3 qualitative analysis?

There are three major approaches to qualitative research: ethnography (drawn from anthropology); phenomenology (drawn from philosophy) and grounded theory (drawn from sociology).