Share what you know with millions of people

Focus is the best place to turn what you know into remarkable content
×
0

How important is a "percentage complete" bar when taking a survey?

Researchers sometimes provide "percentage complete" bars on their surveys as a means of informing the respondent of their progress. These can be informative tools for promoting proper expectations for the survey commitment, but not everyone uses them. In fact, not all survey software tools provide this as a design option. How important is the "percentage complete" feature in your survey experience? When would be a time when it is best not to use?

Attachments

1
Alan Dash
Technology Designer/Consultant , Syska Hennessy Group
Posted on June 27, 2011

I think it would be a great tool if they actually worked! There's times when it seems to simply be a rectangle bar that arbitrarily moves to the right without being based on a set metric. I’ve had them half way across, then when I responded to the next question, it was over. And I’ve had it the other way – one question fills up a third of the bar, and the next ten questions fill up the next third. Perhaps this is because the manner in which I responded drew no further questions, or stimulated additional questions, or perhaps it’s a marketing tool to make you think you are almost done. For me, after one or two bad impressions of a technology, I’m done relying on it…….

0
Jessica Groopman
Jessica Groopman Replied on June 27, 2011

This is a great point Alan. All 'expectations' aside, I too have experienced this... inconsistency in % complete per page. I do believe it is a great tool when it works, and works intuitively... otherwise you're right, in some cases it can backfire, causing respondent distrust!

0
Angel Tuccy
Angel Tuccy Replied on June 28, 2011

I also agree with Alan - the purpose of the tool is to communicate to the customer. if it works, it's valuable. If it doesn't, it's worse than not having one at all.

1
Sam Ho
Research Manager, 2CV
Posted on June 28, 2011

It's often inconsistent or misleading because some surveys factor in hidden pages, dummy questions etc. that the respondent isn't aware of.

On a wider note, I refuse to EVER use them because by using them it's a subtle way of saying " I know you're bored with this, it's nearly over". Any research, quant or qual needs to be perceived as something enjoyable by the respondent. We should be striving to get the best value from our respondents. Any concession that what they're doing is boring should be avoided at all costs.Market research has such a dirty name already - no need to maintain that image.

1
Prerit Souda
Consultant, TNS Global
Posted on June 28, 2011

Very important. Lets tell you a story. In my building there is an elevator which works like a normal elevator.After pressing the up/down key, it does tell that the elevator is coming but won't tell which floor its on. So may be its at the 15th floor or even 2nd floor. This frustrates people because they don't how much time they need to wait. Several people avoid it.
People are more ready and more welcoming if they know how much time they have devoted and how much they are expected to devote more. Time devoted appears more like an accomplishment and time left is more like a challenge(thinking if we have already spent so much time, lets finish it. end is near).

Lastly, I agree that sometimes these indicators are dubious but thats the fault of survey designer who in a sense cheats respondent on their time.

1
Paul  Ogle
Internet Marketing Manager, Focus
Posted on June 28, 2011

As a frequent survey respondent I think the bar is a very powerful tool when you are doing a short survey. I end up taking a lot of surveys that are passed along to me by colleagues with a request for "a few minutes" and most of the time 2-5 minutes is all that I have to give a survey. If I have answered 10 questions and I am 25% through the survey, sorry but I am going to have to ditch it. I do take a fair amount of longer surveys on topics that I am very interested in and want to allocate enough time to give insightful answers, in those cases the completed bar has a smaller impact on me.

0
Brian LoCicero
Brian LoCicero Replied on June 28, 2011

So Paul, would it be fair to say that if the length of the "few minutes" survey were more accurately given to you, your opinion would be the same as that for the longer surveys on topics you are interested in?

I guess my concern with how you answered (and it's not a wrong answer an honest one) is that by ditching it, it potentially is impacting the results, depending on eventual base size. This should NEVER be a concern of the respondent/you but it should very much be a concern of us as researchers.

0
Paul  Ogle
Paul Ogle Replied on June 28, 2011

You hit the nail on the head. I have been told that the survey will take "a few minutes" many times when it really ended up taking 20+. I am happy to give my insights as long as the survey time is accurately defined to me even if it is a topic that isn't at the top of my interest list. I have been on the other side of the phone / survey in the past and know that by underselling the time it will get more people involved which may be the goal (they need 250 responses to get decent data) but also understand that if I complete the entire survey without putting any thought into my answers I may be throwing off their results by giving poor answers. I would hope that when I do ditch a survey the answers that I gave for 1/2 of the questions would be discarded.

1
Kent Lewis
President, Anvil Media, Inc.
Posted on June 28, 2011

Based on my experience, critical to maximizing response rates! People need to get a sense of commitment level expected, in terms of time & effort. The progress bar solves a few problems in that way.

1

As a frequent survey respondent and a market researcher, here is what I feel about them

Pros:

1) Gives a sense of length to the respondent continuously. Important when doing lengthy paid surveys.
2) Reflects the surveyors genuineness in projecting how laborious the survey could be. I appreciate it personally.
3) If the progress is quick, respondent can gauge that survey is short and would be more patient and accurate when responding.

Cons:
1) Instills boredom when responding to long surveys, especially unpaid ones.
2) Respondents try to run through the survey if the progress is minimal with each response.
3) Can be a motivating factor for respondents to leave the survey mid way.

Summing up, I like them for short or long paid surveys, but not for lengthy unpaid surveys.

0
Andrew Baker
Director, Service Operations, SWN Communications Inc.
Posted on June 28, 2011
  • Recommended by:

I like them, as a respondent, because they give me some assurance of when I'll be finished. Granted, if I really like the survey, I don't tend to pay attention to them, but not every survey is like that, and it has saved me from abandoning the survey (especially for an entity with which I am not familiar).

0
Brian LoCicero
Operational Account Director, Kantar Operations
Posted on June 28, 2011
  • Recommended by:

We've had this debate countless times internally and keep coming to the answer "NOT VERY" important to have them.

The hope is that, as an industry, we're not subjecting respondents to horribly long surveys that NEED a progress bar. It's a tall order and almost impossible, but alas, we can all hope, right?

Most have hit on this already but routing has gotten so complex on some surveys that in fact, the progress bar can work AGAINST the stated desire of being friendly to the respondent.

In 5 years when everything has to be done on mobile devices/tablets, we won't even be allowed to ask more than 5-minute bursts of questions so this will probably make this discussion moot. (again, a HOPE, not necessarily fact, just my thoughts)

Answer This Question