Monday, April 12, 2010

Benchmarks - How Good Are They?

In the latest issue of Quirk's Marketing Research Review (April 2010), there is a survey of researchers regarding benchmarking. The survey was performed in the Spring of 2009 with 97 responses from people involved in market research in their organizations (83 have a designated market research function). The survey was performed by Jennifer Van de Meulebroecke and Michele Sims both members of the staff at TRC Market Research in Fort Washington, PA. The researchers represented many markets including insurance, utilities, high-tech, health care and financial services.

The researchers noted that:
1. 75% of the researchers collected benchmark data as part of an internal study,
2. 56% of the researchers collected benchmark data separately or at a different time than other studies. Some also use an outside vendor for assistance.
3. 56% of the researchers used a syndicated source for their benchmark data.

The research went farther by asking the researchers to focus specifically on benchmarking data and describe their confidence in making comparisons for their company with benchmark data. The results indicated that 75% of the researchers who had less than 11 years in market research had confidence in using external benchmarking data; whereas only 58% of those with more than 11 years in market research had confidence in using the external benchmarking data for comparisons. The conclusion drawn from this piece of information is that it appears that the longer people are in market research, the less trust they have in using the external benchmark data to draw comparisons.

Since there are such low scores with respect to using external benchmark data, the question is what are the factors that people should be aware before using external benchmark data. The survey found the following factors and are ranked in order of importance by those who were surveyed:
1. 91% were concerned about the consistency of the scales and responses,
2. 83% were concerned with consistent question wording,
3. 77% were concerned with consistent screening,
4. 67% were concerned with the method of collecting the data (web, phone, etc),
5. 58% were concerned with type of sample that was used, and
6. 51% were concerned with the time period for data collection.

As an editorial comment I would note that many companies put extreme value on industry benchmarks. I had a consulting assignment several years ago with a high-tech company that had the lowest scores on their industry benchmark. The executives and managers were very concerned about their score. They believed, and rightly so, that thefact that the benchmark that showed they had the lowest scores in their industry would impact their sales. They asked for my help and within 3 years they were tied at the top of the industry benchmark. The problem was that they were scored low but did not have enough information to know where to make changes to their product nor support. Once we captured the information it was only a matter of time before they moved to the top.

The bottom line is that benchmarks are becoming more and more important to companies. Today many companies use benchmark data to assess their market position without understanding how the benchmark was created. In addition, the companies do not have the detail information necessary to accurately evaluate the meaning of the benchmark scores. The lesson is benchmarks are very valuable when used properly but can be VERY misleading when not properly understood.

9 comments:

Accounting Dissertation Help said...

it's good to see this information in your post, i was looking the same but there was not any proper resource, thanx now i have the link which i was looking for my research.

Anonymous said...

First of all I would like to say awesome blog! I had a quick question that I'd like to ask if you do not mind. I was curious to find out how you center yourself and clear your thoughts prior to writing. I've had
a hard time clearing my mind in getting my thoughts out. I do enjoy
writing but it just seems like the first 10 to 15 minutes are wasted just trying
to figure out how to begin. Any recommendations or tips? Thank you!


Feel free to visit my website: http://edgarsisc.ireallylikefood.com/...

Anonymous said...

Hi there, yup this piece of writing is actually nice and I have learned lot
of things from it regarding blogging. thanks.


Feel free to visit my weblog: Slim Green Coffee REview

Anonymous said...

Thanks soo a lot i necessary this

Here is my web page :: diet for Building muscle mass men

Anonymous said...

Great work! This is the type of info that are meant to be shared
across the internet. Shame on the search engines for now not positioning this
publish upper! Come on over and consult with my web site
. Thank you =)

Feel free to surf to my webpage - office furniture rental new york city

Anonymous said...

WOW just what I was searching for. Came here by searching for pure garcinia

Anonymous said...

What's up, everything is going perfectly here and ofcourse every one is sharing data, that's in fact excellent, keep up writing.



Also visit my homepage: Xtreme Gain Muscle Review

Anonymous said...

Hi every one, here every person is sharing such knowledge, so it's good to read this blog, and I used to pay a visit this weblog daily.

Also visit my page; cambogia garcinia

Anonymous said...

I read this post fully on the topic of the resemblance
of latest and earlier technologies, it's awesome article.

Also visit my webpage - IGF-1

 

web visitor stats
OptiPlex 755 Desktops