The fatal flaw in attempts to measure brand experience

measure brand experience

The recent news of the IPM’s efforts to develop a standardised measure to evaluate brand experience has been greeted enthusiastically by the industry. It’s not hard to see why.

Nail this and we will have finally ‘grown up’, taking our place at the client’s top table alongside other more established disciplines that traditionally have called the shots. Experiential marketing budgets will swell as age-old misgivings are swept aside, and none of us shall ever again be subject to the awkward grillings that our colleagues in other areas of marketing seem to avoid.

So yeah, it will be pretty great. Or at least it would be if it were possible.

While there is no doubt that this project will provide many valuable learnings that will sharpen our measurement abilities, one thing it categorically won’t do is provide a single standard formula like those enjoyed by other channels. The reason for this is simple: brand experience isn’t a channel at all.

The definition of a channel is a consistent format that can carry a marketing message. TV, for instance, is an obvious channel, since all ads are carried in fundamentally the same way (30 seconds of video in between programmes), no matter what their creative idea. It is this formal consistency that allows for consistent measurement – there are no variations from one campaign to another that would require a change in methodology.

Brand experience on the other hand, has almost no formal consistency. As IPM Experiential Council Chair Jessica Hargreaves said in her recent piece in Event: “From sampling to intimate events and stunts, to huge festival experiences, the world of experiential is very broad.” Indeed, how much similarity is there between, say, a washing machine demo at the Ideal Home Show and a projection mapping stunt on the Houses of Parliament? What is the channel here? And what if the demo includes a Facebook mechanic, and the stunt gets a million views on YouTube? Are the channels here Facebook and YouTube? Or are they experiential? Or both? Which pieces of the campaigns are you measuring?

The point here isn’t that these campaigns can’t be measured. It’s just that they require different methodologies – especially if they actually work, as so much experiential does now, by blending different channels. We find that in many cases researching one campaign might actually come down to researching three or four different things, and then blending them to get the full picture. Or even if we research two campaigns that superficially might appear similar (say, two tactical sampling campaigns) we might have to change the methodology totally due to one small difference between them. This is not channel behaviour.

We might wonder, therefore, if experiential isn’t a channel, then what is it? I would suggest that experiential is in fact a technique of marketing, a technique that can be applied to channels, but which isn’t a channel itself. The clue is all in the grammar – experiential isn’t a noun (like TV), it’s an adjective. It describes the characteristics of something, not what it is. The characteristic, in this case, is broadly ‘something that’s activated in the real world’ – even if the end audience doesn’t experience it that way. This is why we call live stunts that go viral on YouTube ‘experiential’. Clearly most people don’t ‘experience’ them – they’re just sitting at their computer – but the fact that the original idea was activated ‘live’ gives the work that character.

For a similar example, imagine I was to talk about ‘scary marketing’. This too would be a technique – describing a piece of work without defining its structure. Clearly it would make little sense to attempt to create a unified measurement formula for scary marketing, and yet this is what we are trying to do with experiential.

If our aim is to prove the effectiveness of experiential, a good approach would be to explore how it can have a multiplying effect on other channels. Often our campaigns involve getting brands to prove their claims, which can lead to much more engaging content in this post-reality TV age. We also engage real people in our work, which has obvious implications on social channels. Ours is an eminently measurable discipline – we just have to zoom out a little bit.

I look forward to the insights of the project, and hope they will help us understand the effectiveness of our work at another level. But let’s not try and unify what we do. We’re bigger than that.

Alex Smith is Planning Director at Sense.

You might also be interested in reading our post about measuring experiential marketing campaign ROI, which goes deeper into the how of measuring brand experience.

London

5th Floor Century House
100 Oxford Street
London
W1D 1LN

New York

243 E 14th St,
#2, New York,
NY, 10003

Discover our latest guides to help brighten your brand experience strategy or amplify your shopper marketing moves. Get them here at The Futures Lab.

London

5th Floor Century House
100 Oxford Street
London
W1D 1LN

New York

243 E 14th
#2 C/O SQ
New York
NY 10003

Downloads

Discover our latest guides to help brighten your brand experience strategy here at The Future Lab

Connect with us

Experiential

Whether it be Festivals, Trade Shows, PR Stunts, Installations or Pop Ups to name a few, we believe brand experiences are one of the most powerful forms of marketing to impact consumer perception and attitude towards a brand. They can create real behaviour change when born out of a deep consumer insight allied to a compelling idea. And it’s these fundamentals we look to get right whatever the live, virtual or hybrid task in hand.

Sampling.

Sampling is all too often perceived as an unsophisticated, somewhat ‘blunt’ marketing tool. Over the last 16 years Sense has pioneered a set of strategic principles which underpin our unique approach to sampling and which are highly measurable from both an ROI and consumer behaviour change perspective. We will happily guide brands through the myriad of sampling channels and products available so whether it’s mass face to face sampling, in offices, digitally, at home or just a strategic framework that you are after, we can provide a blend of tactics to fulfil both brand and sales objectives.

Retail.

With many clients now focused on activating in channels more closely associated with a sale, our heavyweight retail experience closes the loop on a typical shopper journey by encompassing the moment of truth in store. Be it prize promotions, shopper toolkits, key visual creation, path-to-purchase communications, category strategy, B2B campaigns or Amazon optimisation, our goal is to create forward-thinking retail experiences that deliver demonstrable brand value. We aim to make ‘retail fail’ a thing of the past for ambitious brands looking to thrive is an ever-competitive landscape and believe our streamlined team is perfectly placed to do this.

Foresight.

Knowing what will keep a brand bright, exciting, and vital means we need to keep one step ahead of the curve. Our thought leadership hub, The Futures Lab, helps us to understand the marketing trends of tomorrow. It’s also the origin of strategies and methodologies which have created over 65 award-winning campaigns. 

Rigour.

Creativity is nothing without results. And we know that commissioning bold concepts, capable of changing minds, requires reassurance that it’s the right thing to do. 

Data, insights, and research precedes every campaign we do, and our proprietary measurement tool, EMR, gives us a decade of campaign performance metrics. Which is why we’re proud to have been recognised as industry-leading by brands like The Economist, Coca-Cola, and Molson Coors. 

Trust.

We believe brand experience is inherently more varied than other forms of marketing. No formula, no template, no cookie-cutter approach – and often no precedent. 

That’s why, Sense places trust at the heart of its business – grounded in teamwork between our people and yours. Our processes are efficient, our senior team stay involved and our partnership mentality had helped us sustain powerful client relationships, some lasting over 10 years.