There’s a fantastic scene from the old TV series, ‘Yes, Minister’, where the senior civil servant takes his bumbling, inept minister through the complexities of how surveys lie. The original text (full credit to the authors, Antony Jay and Jonathan Lynn!) is this:
Sir Humphrey: “You know what happens: nice young lady comes up to you. Obviously you want to create a good impression, you don’t want to look a fool, do you? So she starts asking you some questions: Mr. Woolley, are you worried about the number of young people without jobs?”
Bernard Woolley: “Yes”
Sir Humphrey: “Are you worried about the rise in crime among teenagers?”
Bernard Woolley: “Yes”
Sir Humphrey: “Do you think there is a lack of discipline in our Comprehensive schools?”
Bernard Woolley: “Yes”
Sir Humphrey: “Do you think young people welcome some authority and leadership in their lives?”
Bernard Woolley: “Yes”
Sir Humphrey: “Do you think they respond to a challenge?”
Bernard Woolley: “Yes”
Sir Humphrey: “Would you be in favour of reintroducing National Service?”
Bernard Woolley: “Oh…well, I suppose I might be.”
Sir Humphrey: “Yes or no?”
Bernard Woolley: “Yes”
Sir Humphrey: “Of course you would, Bernard. After all you told you can’t say no to that. So they don’t mention the first five questions and they publish the last one.”
Bernard Woolley: “Is that really what they do?”
Sir Humphrey: “Well, not the reputable ones no, but there aren’t many of those. So alternatively the young lady can get the opposite result.”
Bernard Woolley: “How?”
Sir Humphrey: “Mr. Woolley, are you worried about the danger of war?”
Bernard Woolley: “Yes”
Sir Humphrey: “Are you worried about the growth of armaments?”
Bernard Woolley: “Yes”
Sir Humphrey: “Do you think there is a danger in giving young people guns and teaching them how to kill?”
Bernard Woolley: “Yes”
Sir Humphrey: “Do you think it is wrong to force people to take up arms against their will?”
Bernard Woolley: “Yes”
Sir Humphrey: “Would you oppose the reintroduction of National Service?”
Bernard Woolley: “Yes”
It’s a brilliant bit of writing in its own right, but it also demonstrates a damn groovy point – that for every statistic you hear, every on-the-spot poll we find earnestly being discussed on the news, there are choices which have been made in the questions which were asked, and the people who answered them, which are almost never addressed as we are informed that this many people DEFINITELY think that, or that many people ABSOLUTELY reject this. A friend tells a story of this taken to an extreme: leaving customs at Heathrow one day, he observed a woman from British Airways stopping customers and asking them the following question:
“Excuse me, sir, may I ask you to rate your flying experience with British Airways? Would you say your experience was good, very good, or superb?”
I would be surprised if the managers of British Airways didn’t feel pleased with themselves when the poll results came in. Every day we are bombarded with information which is, at a deeper analysis, probably nothing of the sort. There is some truth in the maxim that everything you hear on the news is true… except for the 1% you happen to know something about. In this age of high-speed news services, of online entertainment, of globalisation and rapid communication, we tend to like quick answers and easy absolutes. I was genuinely distressed to read an ad on the Underground for a magazine who’s tag line was ‘Read Less, Know More’. It’s a tantalizing idea, but I can’t shake the feeling that more than anything, we’re reading less, and believing more without ever bothering to ask how much bigger the issue is at stake. Even the way information is presented to us, can often be misleading. Witness pie charts and graphs on the news, which show great rises and dips, huge chunks of wealth or power or [insert topic here] being created and destroyed around us… and only if you look really closely will you spot that actually the axis against which all this is plotted is five minutes on a Thursday afternoon, and the wealth in question is three pounds in a piggy bank, rather than the great sweep it proports to represent.
That said, sometimes simple means of expression have a certain charm. I was recently introduced to this website…
http://www.informationisbeautiful.net/visualizations/the-billion-dollar-o-gram-2009/
… and love it. It’s not merely that I like visual representations of ideas, but the very title of the website – ‘Information is beautiful’ appeals to me. Information is cool, interesting, important, and never, ever as simple as a tick box at the bottom of a quick survey. Complexity is beautiful. Complexity is what we’ve gotta live with.
4 comments
Calum Grace says:
June 20, 2012 at 12:24 am (UTC 1 )
Ah, how the human brain loves to take short-cuts. It loves the easy answer, it loves the quick fix of information, rather than the long haul of weighing different sources against one another. It loves to eschew complexity in favour of simplicity. I run into this myself, every day, with each new news story or data point bandied about on the internet, I find myself thinking “oh, aye” and moving on, only realising afterwards that maybe I should have read further, rather than skimming in my never-ending quest for MORE INFO, DAMMIT.
That graph is rather attractive, though, I must admit
Catherine Woodberry says:
June 21, 2012 at 1:22 am (UTC 1 )
This is fabulous! I’ve always loved the way you write – from way back (I have all of your books including the Catherine Webb ones) but this particular blog is spot on! Well said.
Oh and congratulations on the run too!
Catherine
GB Steve says:
June 21, 2012 at 12:39 pm (UTC 1 )
As a government statistician this stuff is pretty close to my heart, especially as I’m currently focussing a lot of effort on data dissemination and visualisation. The kind of thing you see presented as data visualisation is the apex point of a long process. It starts with statisticians involved in data collection and presentation, then it goes through policy people looking at the message which the government wishes to convey and finally it’s filtered through a design process to make it look attractive.
We statisticians have a code of practice about providing quality data with equal access and no political bias. On the whole, I think this is achieved but it’s not the message that the public sees, unless they want to troll through the raw figures on the Office for National Statistics website.
xkcd has some lovely graphs (yesterday’s was about all the exoplanets) which are quirkier than IIB.
David Brider says:
June 29, 2012 at 1:06 pm (UTC 1 )
Ah, y’can’t beat a bit of Yes, Minister.
I quite like the notion in Dirk Gently’s Holistic Detective Agency (the radio adaptation, anyway – I can’t remember if it was in the original novel, but I suspect it was) of an accountancy program that, instead of rendering the numbers as graphs, charts, diagrams, etc., renders it as music.
Daft question – there’s a bunch of us over on Facebook wondering how old Matthew Swift is supposed to be. I have a vague recollection of it being implied that he was mid-20s in the first novel, but beyond that, the consensus seems to be he’s in his 30s. Also – and this is where the conversation started – if one day there’s a film of The Midnight Mayor – who should play Swift?