Numbers and Stories

Just after noon, on a weekday, I bumped into a family acquaintance at one of the more successful shopping malls in the city.

The question, “What are you doing here?” was underlined by a mildly accusatory look and the subtext, “Why are you spending a week-day shopping?”

My response that I was “working” wasn’t enough; the further explanation that I was doing “research” received a dismissive smirk and ended the conversation. The fact is that I was repeating the time-honoured ritual of RBWA (research by walking around), with its seemingly aimless strolling, sidelong glances, and possibly turning over a hundred items in a dozen shops without reaching for the wallet even once. This is a ritual that is not taught in our temples of management learning. In fact, it is one of the many tens of methodologies that seem to be missed out during the course of our formal education. And very often, what we do get taught is so remote and opaque to most people that they will promptly forget it the moment they walk out of the examination hall.

I was reminded of this walk-about incident during a conversation with two members of the faculty of a professional institute on the subject of research. Most of their students, I had observed, had a narrow interpretation of research – focussed only on consumers being interrogated through a questionnaire. The students were working from the guidance they had received during the previous semesters at the institute.

Unfortunately, the students are not alone – this is also how too many people identify research, including many executives in decision-making positions. I have been frequently puzzled by the confident (brash?) statement I have heard many times: “We don’t need research.” It is only when I probe further do I, and they, discover that while they perhaps don’t need consumer surveys, there are large gaps in their decision making toolkit which can only be filled by inputs from various other kinds of research.

Sometimes the roots of that statement lie in the perception of research as an impenetrable jungle in which it is easy to get lost but difficult to find something immediately useful. Researchers, like all other vocations, have their own professional shorthand (also known as “jargon”) which they sometimes use to identify their own kind, and perhaps sometimes to exclude people who are not from the trade. Very often this jungle is created by “research-as-a-foreign-language”, which many executives are just too apprehensive or too busy to tackle.

But before you pick up the axe and start cutting away at the creepers of bi-variate analysis, quota samples, correlation and projective techniques, let me give you my very simple definition of research which I like to keep in mind when I am asked the question: “Do we need research?”

To me, research is the discovery and collation of diverse pieces of information from various sources, so that it can be analysed using multiple tools, to discover relationships, patterns and directions that can be used to draw conclusions and take decisions.

There is a purpose for which we would discover or collate that information. There may be a set of questions that we need to answer. We need to understand what are the various places where that information may lie, the different forms it might take or the different ways in which we might need to look at the information before anything useful emerges.

And, in the business context (as in many other situations), research is meant to come up with something that is applicable and directly beneficial to the business. So once we’ve got most of the answers we were looking for, it is certainly useful to stop and apply the newly gained knowledge rather than try to refine and perfect it to the infinite degree.

If this definition of research frames the context well enough for you, then you’re on the way to doing and using research well.

Despite the wealth of information available today, far too many bad business decisions are being made in the absence of good information, either because the executives have not bothered to carry out research, or have not had the capability or the time to question the research which is being presented to them.

Worse – perhaps because of the abundant data and the ease of access to it – today many business decisions that turn bad are taken on the basis of information that is presented by someone else (“secondary research” in research language), without questioning the validity of the conclusions, the structure of the study, the context in which the data was analysed. It’s almost as if we couldn’t be bothered to think, because someone has apparently already done the thinking for us – especially if it comes from a “reputable source”. (Ok, that might be smart sometimes. So let me give you a more graphic analogy – could you think of an adult bird regurgitating pre-digested food to feed the chicks? Hmm, not so pleasant an image after all, is it?)

Also, research (especially the number-oriented kind) seems too dry for most people to take in. And I think that is one place market researchers could do themselves a huge benefit if they could tell the story – especially a story with a moral at the end. That is, create the picture for the user as to what all of that information means in simple language, and also show the user how to use the information in the context of his situation or problem. Bedtime stories during childhood and good movies in adulthood work well because there is a coherent narrative, a start, a middle that is interesting and an ending that stays in the mind. You can see the relationships between the characters, and the consequences of those relationships. A good research project report could be seen as something very similar.

Having said that, of course, there are also some researchers go far beyond, who would never let boring facts get in the way of a good story! Apparently a letter to the editor of the National Observer (London) as far back as 1891 complained: “there are three kinds of falsehood: the first is a ‘fib,’ the second is a downright lie, and the third and most aggravated is statistics.” (Mark Twain famously paraphrased this in his autobiography as “lies, damned lies and statistics”.)

How many stores can you think of which are located at sites where their chances of success are exactly the same as that of a snowball in hell? How many products or brand launches come to mind, where you wondered, “what is this company thinking?!” Of course, there would have been pre-launch studies which would have showed just how successful these would be, where the stories were possibly based more on imagination than on facts.

For a decision-maker, the only way to tell the difference between bad statistics (lies) and the true story of the market is to make sure that he or she is equipped with multiple sources of information, and various tools with which to analyse them. Also, if you recall my earlier definition of research, the starting point was the definition of the objectives which a research is supposed to fulfil – if the objectives are vague or undefined, so will the research outputs be.

Numbers (quantitative research) and narrative (qualitative research) can tell us many wonderful stories about the market. Some of those stories are highly imaginative “fairy tales” because of a bad study – that shouldn’t lead us to ignore all the others which can direct us to our objectives.