Why the “Open Data Movement” is a Joke

 Two recent announcements from Canada prompt my mood this morning:

A government can simultaneously be the most secretive, controlling Canadian government in recent memory and be welcomed into the club of "open government". The announcements highlight a few problems with the "open data movement" (Wikipedia page):

  • It's not a movement, at least in any reasonable political or cultural sense of the word,
  • It's doing nothing for transparency and accountability in government,
  • It's co-opting the language of progressive change in pursuit of what turns out to be a small-government-focused subsidy for industry.
  • In short, the open data movement is a joke. Those who are on the political left who lend their support to it have some hard decisions to make.

    The Canadian Case: Open is an empty word

    The Harper government's actions around "open government", and the lack of any significant consequences for those actions, show just how empty the word "open" has become. For readers outside the country, here is a selection:

    • Cancelling the compulsory long-form census (link), thereby demolishing a source of reliable statistical data that guides government decisions and debates over national priorities. "The information previously collected by the long-form census questionnaire will be collected as part of the new voluntary National Household Survey (NHS)." The decision prompted Statscan head Munir Sheikh to resign (link).
    • Firing Health Canada scientists who speak publicly on drug safety issues (link). [Update: as "d" comments below, this was the Liberal government in 2004]
    • Muzzling Canada's public scientists in other departments, with one example being Fisheries and Oceans scientist Kristi Miller (link). More broadly, "Natural Resources Canada scientists have had to get pre-approval from Minister Christian Paradis's office to speak with journalists. They must also get ministerial approval for everything they say to the news media." (link).

    It's got to the stage where the Canadian Association of Journalists recently awarded its "Code of Silence" award for Canada's most secretive government or publicly-funded agency to the entire federal government (link).

    While there has been opposition to these moves, I think it's fair to say that the "open data movement" has not been central to it. But never mind, Statistics Canada data is now available for free on the government's web site (link). There seems to be no link between the government's actions and the actions of this "movement", and basically that's because the Open Data Movement is more focused on formats, digitally-acessible data sets, free access to postal codes, and so on than it is focused on actual government transparency around issues that matter. It's a movement that has had no impact on government accountability.

    Who is the Open Data Movement?

    Am I being unfair? Who, after all, is the Open Data Movement? Well it turns out there isn't one really, at least when it comes to "open data" in the sense of "open government data", which along with "open scientific data" is one of the two most common uses of the term.

    "Open Data Movement" is a phrase dragged out by media-oriented personalities to cloak a private-sector initiative in the mantle of progressive politics. Along with other cyberculture terms ("hacktivism", "unconferences", "hackathons") the word "movement" suggests a countercultural grass-roots initiative for social change, but there isn't anything of the sort that I can see.

    Take Tim O'Reilly, who has thrown the phrase around for some time (see here for an example from a couple of years ago). Like others who use the phrase, he sees no conflict between civic culture and corporate interests, so the Strata conferences and Open Government conferences he has run have been sponsored by major software, hardware, and computer services companies (including, I think, my employer, for whom I do not speak). Strata 2012, for example, is co-hosted by Cloudera, sponsored by EMC and MapR, and many others.

    Or take the "Code for America" initiative, which uses language that is explicitly about promoting an alternative vision of how government works ("it's about citizenship and how the internet is fundamentally reshaping the way government can work", It's "a Peace Corp for geeks") and which has many well-intentioned people involved. Yet when it comes to it, there's a lot more here about making uncontroversial data available (including for commercial use) than there is about anything like challenging government on actual accountability or transparency. So it's no surprise that the list of donors includes major corporations like EMC (again), ESRI, Google, O'Reilly Media, and Microsoft.

    It's not that there's necessarily anything wrong with Code for America, more that it's not a movement in any political or even cultural sense. Another member of the CfA donor list is the Omidyar Network, set up by the eBay billionaire Pierre Omidyar, and it reflects his view that private sector corporate profit-making activity and civic activity are not in tension, but complement each other.

    As a result, the actual activities of this "movement" end up being to push for government subsidies of private-sector activity. It's "big society" all over again. This is the TED worldview, so it's no surprise that the recent Open Government Partnership wraps itself in noble goals such as fighting "corruption, closed doors, the consolidation of power" (see Hillary Rodham Clinton's remarks) and basks in the reflected virtue of TED fellow Walid Al-Saqaf (Open data vital for a new Yemen) when the most likely outcomes are privatisation initiatives of the kind promoted by Francis Maude.

    Abandoning "Free for Commercial Use"

    Progressives involved in open data work, of which there are many, could do something useful here. In order to prevent actions around government transparency being hijacked as a front for corporations to get at subsidised raw material, they could promote a "non-commercial use" license of the kind that is an option under some variants of Creative Commons content license.

    Until now, groups and individuals with some credibility on the left have maintained constructive if arms-length relations with the corporate/civic almagam that is the Open Data Movement. It's time for them to draw a line, and not let their own often-admirable initiatives get used as a smokescreen for privatisation and small-government initiatives.

    Are any doing so, or are there explicitly-progressive initiatives that are making a difference? I'd be interested to hear.

    More reading

    Basically, this post follows on from this and this, which I wrote a couple of years ago.

    Click to Judge

    I recently contributed an essay to the always-excellent Literary Review of Canada, which is out in the April issue and is one of the contributions that they have put online so you can read it in its entirety for free here, you lucky people. It's a review of an essay collection called "The Reputation Society", edited by Hassan Massum and Mark Tovey. Unfortunately I didn't like the book much. The concluding paragraph of my review is this:

    There is a need for inventive and serious thought about the issues of reputation and trust in an increasingly digital world. Our social and commercial interactions will be increasingly mediated by large-scale software systems, and we need ideas about how best to design, navigate and regulate these systems. Unfortunately, by avoiding real-world cases and thorny problems, The Reputation Society provides no answers.

    My starting point for the review, although it's not explicit in the essay, is that information asymmetry is at the heart of anything to do with trust, reputation, and the market; and despite what some optimists claim, sheer volume of opinions does not solve the problem. Recently, I even deleted this paragraph from the Wikipedia article on Information Asymmetry:

    Although information asymmetry has recently been noted to be on the decline with the rise of the internet, which allows ignorant users to acquire hitherto unavailable information such as the costs of competing insurance policies, or the price of used cars, it is still heavily applied to human resource and personnel economics regarding incentive schemes when the employer cannot continually observe worker effort.

    "The costs of competing insurance policies, or the price of used cars" has nothing to do with information asymmetry. The question is, how do you know if I'm telling the truth, when I have an incentive to distort it? How can we establish trust?

    Wikipedia itself provides a useful case study. For many topics there is little incentive for a contributor to provide false information beyond the thrill of vandalism, and the fact that such vandalism can be undone with a single click means that trust is not a significant issue throughout many parts of the encyclopedia. Why would anyone lie about the birth date of Henry III of Castile being 4 October 1379? As a result, "anyone can edit" applies and the encyclopedia has become the phenomenon it is.

    There is a small number of pages (several thousand of the 3.3 million in English Wikipedia, or 0.1%) that are the subject of repeated edit wars, and which "are semi-protected to reduce the risk of inappropriate editing". The policies and practices around these pages have undergone continual revision (Seth Finkelstein will know more) and the costs of maintaining neutrality are high; one way or another, when there is a conflict of interest, it needs special treatment.

    When it comes to reputation, there's always a conflict of interest. A hotel has an interest in promoting its own image, and in worsening the image of its competitors. Simply throwing open the floodgates doesn't resolve this basic problem, and the paragraphs on TripAdvisor at LRC explain why. (That said, I have no doubt my cousin's place Riad Africa, in Marrakesh, is indeed a wonderful place to stay).

    On the web, as elsewhere, there will be many ways explored to solve the proble of trust. Angie's List takes an approach that is almost the opposite of TripAdvisor in its reviews of contractors and services: it requires membership, and all reviews are checked by a human. A result is that, success or not, Angie's List is run much more like non-web reputation services: restaurant review guides, holiday home guides, and so on. If the main benefits of the web are free-for-all Wikipedia-style contributions, then it remains to be seen how reliable it can be for issues like reputation, where conflict of interest and asymmetric information are the sticking points. 

     

    Wikibollocks: Mathew Ingram and Seth Godin on publishing

    Here's most of Matthew Ingram's article about a Seth Godin interview with added intemperate and unedited and probably ill-judged commentary from yours truly. The Mathew Ingram article is indented.

    Thanks to the rise self-publishing tools, from Amazon’s Kindle platform to Apple’s iAuthor software, anyone who wants to write a book can do so and theoretically reach an audience of millions — as self-publishing superstars such as Amanda Hocking and John Locke have shown.

    This is meaningless. In one sense it's been the case for a hundred years that "anyone…can..reach an audience of millions". You didn't even have to go through a publisher (Virginia Woolf). But for most people, going through a publisher is easier than self-promotion, which for most people is very very difficult. So to claim "anyone" can self-publish to millions is just ridiculous. We can write off Salinger, Pynchon, Harper Lee, Samuel Becket, or Cormac McCarthy for a start. Promotion (not to mention editing and more) takes a certain kind of person. Not everyone can do it. I can't. 

    But this explosion of amateur authors and publishers also means a lot more competition for an audience.

    I'm sorry, "amateur authors"?? Most authors have always been amateur in the sense of not having a regular job as an author. If Amanda Hocking is an amateur (income from her books, millions) and I'm a professional (income from my book, hundreds) then someone is looking at the world upside down. Plus, in the first paragraph MI is implicitly claiming that it's easier than ever to reach an audience, and in this paragraph he's saying it's harder than ever (more competition). Make your mind up Mathew!

    So how do writers make money? First of all, according to author and marketer Seth Godin, they have to give up the idea that they somehow deserve to be paid for their writing.

    It's straw man time. Who are these authors? I know several authors, and none who feels the sense of entitlement of which Godin accuses them.

    In a recent interview with Digital Book World, the writer and creator of the Domino Project — a joint publishing venture with Amazon that he recently wound up — was asked about his advice that authors should give their books away for free and that they should worry more about spreading their message and building a fan base instead of focusing on how to monetize it right away.

    This is a model that will work for a very few people, but for most will fail. It's bad advice.

    And how would he respond to writers concerned about their ability to make a living from their writing? Godin’s response:

    Who said you have a right to cash money from writing? Poets don’t get paid (often), but there’s no poetry shortage. The future is going to be filled with amateurs, and the truly talented and persistent will make a great living. But the days of journeyman writers who make a good living by the word — over.

    Anyone who thinks "the truly talented and persistent will make a great living" should have talked to Vincent Van Gogh. Are there still Van Gogh's in today's world? Of course – we just don't know who they are.

    Perhaps musicians should look to digital royalties? Sadly no. Making money online is a winner-take-all competition, a few will get very rich (and luck has a big say in that, as the well-known Watts-Salganik experiments proved), but most will get somewhere between little and nothing.

    This probably isn’t the kind of message that most authors (or creative professionals of any kind) want to hear, but that doesn’t make it any less true. The rise of the amateur, powered by the democratization of distribution provided by the Web and social media, is something that is disrupting virtually every form of content that can be converted into bits.

    This is a mix of two poses. First there's hard-headed realism: the old world is gone, with a sympathetic wave of the hand. Then there's blind faith that everything is for the best in the best of digital worlds and please don't mention that "the rise of the amateur" is also "the rise of the plutocrat" (Bezos, Zuckerberg, Jobs) and "the democratization of distribution" is also "the monopolization of profits" in the hands of the aggregators. If you promote your work through Twitter, it's not "direct", it's mediated by Twitter, and it's as well to remember that. If you self-publish on Amazon then Amazon is your publisher.

    To take just two examples, the news industry is struggling to adapt to an era where anyone can commit “random acts of journalism” with a blog or smartphone - 

    "Random acts of journalism" sounds cool and fun, but cute phrases don't make reality. Matthew Hindman actually did some hard looking into the democratization of the media and concluded that the spectrum of voices getting heard now is narrower, if anything, than pre-Internet. The rise of the amateur citizen journalist is only half the story. (My comments on Hindman here: self-promotion!) Here is Hindman:

    From the beginning, the Internet has been portrayed as a media Robin Hood – robbing audience from the big print and broadcast outlets and giving it to the little guys. But the data in this chapter suggest that audiences are moving in both directions. On the one hand, the news market in cyberspace seems even more concentrated on the top ten or twenty outlets than print media is. On the other, the tiniest outlets have indeed earned a substantial portion of the total eyeballs… It is the middle-class outlets that have seen relative decline in the online world. Moreover, it is overwhelmingly smaller, local media organizations that have lost out to national sources. (p.100)

    And back to Mathew Ingram:

     — and where sources of news have the ability to publish their own content instead of having to go through a middleman — and photography has been battling the rise of the amateur for years now.

    The "having to go through a middleman" link is to a piece about Rupert Murdoch opening a Twitter account. No longer does Rupert have to go through a middleman! Three cheers for the democratization of distribution! There are many sources of inequality, and attention is one. No one publicizes Jane Minor Author's twitter account, but Rupe – well he's different.

    Nice picture.

    The crucial principle at work in all of these areas is the idea that your real competition isn’t the book or news outlet that is better than you; it’s the one that is good enough for a majority of your audience.

    So maybe the Huffington Post version of that news story isn’t as good as the one in the New York Times, but it is good enough for many readers. And maybe those vampire books by Amanda Hocking or the detective novels from million-selling author John Locke aren’t as good as yours, but for hundreds of thousands of weekend readers they are probably good enough.

    So on the one hand we hear that "the truly talented and persistent" can still make money, but now we hear that quality isn't the issue. Well, one way or another I'm sure the new world will be just dandy. And what is that way?

    Godin’s point isn’t that you can’t make money; it’s that you have to think differently about how to accomplish that task.

    If you’re a mystery writer, can you find 1000 true fans to pay a hundred dollars a year each to get an ongoing serial from you?

    The "1000 true fans" reference is to a Kevin Kelly daydream from 2008 (*). Plausible, but if it sounds like a plan to you, first read John Scalzi and then tell me that's the path you're going to take.

     It’s not the market’s job to tell authors how to monetize their work. The market doesn’t care. If there’s no scarcity of what they want, it’s hard to get them to pay for it.

    The idea, implicit here, is that the market gives people what they want. Let's just agree to differ on that one.

    Who says that artists have a right to make money?

    No one I know. I'll skip the next few paragraphs.

    As media theorist Clay Shirky has pointed out before, abundance breaks a lot of content-related business models that were built on scarcity, and that includes the ones that have supported the book-publishing industry for so long.

    My response to the Clay Shirky piece on content-related business models is here.

    That’s why publishers have been scrambling to try to lock down their content — including jacking up the prices that libraries pay for e-books — and it’s why authors who have a built-in audience are using the Web to connect directly with that audience.

    You really want to talk about locking down content while pointing to publishing on Amazon and iBooks as a way forward? Come on Mr. Ingram, you know better than that.

    Godin’s message may not be a popular one, but it is the way that content works now.

    Again with the hard-headed technological inevitability. But politics, law, and culture has a lot to do with the way that content works. I have hopes that there will be room for many publishing models, with a collection of models – digital and physical. But the biggest threat to a diversity of revenue streams is a reliance on a single deterministic future governed by Amazon, Apple and Google. Fortunately, resistance to Silicon Valley's increasingly disconnected rhetoric is growing, and I think there are still more constructive possibilities for would-be authors than Seth Godin's self-help, positive-thinking brand of marketing.

    Alone Together II: The Unburdening

    [After my first Alone Together post (link), about how much I like Sherry Turkle's use of closely-observed stories, the prolific Rob Horning, now of The New Inquiry among other things, wrote a companion piece (link) on Authenticity, which this post follows. Other things you may want to read about this book include Tom Stafford's Why Sherry Turkle is So Wrong and Mr. Teacup's review.]

    Slippery words: caring and conversation

    When I started reading Alone Together, I didn't expect to end up wondering what a conversation is, but that's what happened, so that's what you get here. Spoiler: my wondering wandered in a circle, first agreeing with Turkle, then disagreeing a little, then a lot, until I ended up largely agreeing with her again.

    What do you think about a seventy-two-year-old woman, Miriam, finding comfort in telling stories toParo, a furry machine designed to care for the elderly and infirm? 

    "Care for?" Turkle writes, "Paro took care of Miriam's desire to tell her story – it made a space for that story to be told – but it did not care about her or her story" {106}. It's not just the word cares that Turkle objects to, but also the word conversation. "To say that Miriam was having a conversation with Paro, as these people [Paro's designers] do, is to forget what it is to have a conversation" {107}.

    Turkle worries about these inauthentic conversations partly because we are so easily seduced by the appearance of caring. We read caring into the actions of robots at the first opportunity, even when we know better. When a robot called Domo simply touches its designer, Aaron Edsinger, he says that "there is a part of me that is trying to say, well, Domo cares." Turkle concludes: "We can interact with robots in full knowledge of their limitations, comforted nonetheless by what must be an unrequited love." {133}

    Rob Horning writes that Turkle has always been concerned with the way that "Users begin to transfer programming metaphors to their interactions with people and psychological metaphors to the behavior of machines." She believes that authenticity is important (real caring, real conversations with real people) and that technology is replacing the authentic with the fake. As she tells the stories—the robot ones anyway, the network ones less so—I can't help but agree with Turkle. Caring robots may be seductive, but in the end their companionship is a deception and should be avoided.

    Authenticity: if you can fake that etc

    There's a catch in Turkle's argument, which many others have noticed: many "real" conversations are not authentic either. Horning takes this point to the extreme: "Nobody can ever show you their 'real' self." Turkle's "concern with authenticity is an expression of nostalgia", and authenticity is "a pressing personal issue now for many not because it has been suddenly lost" but because it is being lost in new and different ways thanks to digital networks. Authenticity itself is not what it used to be.

    I kind of agree with Horning. Even without taking it to that extreme, we clearly spend much of our day in inauthentic interactions, robots or no robots. When the cashier says "Have a nice day", is it the voice of the cashier or the company whose policy they are following? Small-talk and passing greetings are more the enacting of social scripts than authentic exchanges of emotions or views. The scripted responses of call-centre employees just waiting to be replaced by a cheaper technology are obviously inauthentic. The coffee machine at work even tells me to "enjoy your beverage" and I don't really mind that. Where does inauthenticity become a problem?

    Even Turkle's own profession by training (psychoanalyst) has always seemed to me to have a big dose of inauthenticity to it. As a man of a certain age from the north of England the whole "talking about feelings" thing is foreign to me, and as a leftist the idea that markets alienate people from their work is easy to identify with. So I remember being shocked when I first came across people going to therapists in the 1980's. If you do need to talk to someone about your problems, I thought, you should at least do it with friends or family. Going to a counsellor is a bit like going to a prostitute, I thought: paying for something you should get out of affection. You may talk with them, but it's not a real conversation. It's not authentic.

    To be fair, Turkle has heard all this before and acknowledges that "We assign caring roles to people who may not care at all." When a nurse at a hospital takes our hand during an operation, does it matter if the gesture is rote? {133} The market has moved us closer to what she calls "the robotic moment", when certain kinds of interaction are ready to be automated. We know it's not a real person at the other end, so why not just replace them with a machine anyway.

    So if a nurse's hand is OK, but a robot's is problematic, what about when people receive comfort over networks? Is this inauthenticity any worse than that of the market? The market brings new forms of inauthentic interaction into our lives all the time: people who use the language of caring but who are just doing a job. Personal trainers, massage therapists, and all the way to automated voice systems. Or how about conversations while drunk (are we really ourselves?) or how about talking to someone using antidepressants to get through the day (is that really them speaking?) Inauthenticity is everywhere.

    What's a conversation?

    So I started to disagree with Turkle about authenticity and its importance. Next up, the idea of a "real" conversation. A later chapter of Alone Together, about the online confessional site PostSecret (link), made me reconsider my initial agreement with Turkle on this. Maybe Miriam, telling her story to Paro, is not looking for what we think of as a conversation anyway, so much as an opportunity for "unburdening", and unburdening has its own dynamics.

    An example. Sixteen months after physicist Richard Feynman's first wife Arline died of cancer, Feynman – a convinced atheist and one of the most consistent denouncers of fuzzy thinking on record — nevertheless wrote a moving love letter addressed to her (link). "I thought there was no sense to writing. But now I know my darling wife that it is right to do what I have delayed in doing, and what I have done so much in the past. I want to tell you I love you." .

    The letter served an important purpose for Feynman. His daughter Michelle notes that it was well worn: Feynman had re-read it often. There were things he needed to say, and even though Arline was not there to hear them he needed to address these things to her. Feynman's letter is a way to speak out loud (yet in private) to an audience that is important (yet not present). It's sort of a conversation, but also not, and that's the way that unburdening often works.

    Some forms of unburdening have become formalized and surrounded by ritual. Take the Catholic confession: it takes place in a private space, behind a curtain; there is a barrier between the penitent and the priest that serves to emphasize the distance between the two; the solemn ritual surrounding confession serves to emphasize a commitment to privacy, so that the penitent can speak out loud to an audience that is barely there, knowing that what he or she says will go no further.

    Psychoanalysis has taken on many of the same characteristics as confession. The quiet office formalizes the encounter. The guarantees of privacy are emphasized. The patient lies on a couch and the therapist sits out of sight so that the patient is as close to alone as possible. Again, in order to speak things that really matter, we seek an audience of almost zero.

    Even in less formal settings, unburdening is most commonly carried out by expressing intimate thoughts out loud (on paper, on a screen, or by voice) but to an audience that does not know us intimately. How many people have told secrets to strangers they will never meet again? People talk to their pets. Sometimes unburdening has no audience at all; for centuries, private diaries have been receptacles for sorrows and a place to work out problems and dreams. These are the most private of public gestures: secrets we whisper aloud and then lock up, needing to speak them but not wanting them to be heard.

    The posting of confessions to PostSecret is another form of unburdening, of speaking without full conversation. In this case anonymity hides the identity of the penitent, and the role of the priest is taken by the readers and commenters on the site. The site has its own rituals; you don't e-mail your secrets, you must mail a physical postcard with your secret (as it passes through the mail system, it is visible – another anonymous disclosure).

    Turkle sees many acts of unburdening as somehow less than satisfactory. "On the face of it, there are crucial differences between talking to human readers on a confessional site and to a machine that can have no idea of what a confession is. That the two contexts provoke similar reactions points to their similarities. Confessing to a website and talking to a robot deemed 'therapeutic' both emphasize getting something 'out'. Each act makes the same claim: bad feelings become less toxic when released. Each takes as its promise the notion that you can deal with feelings without dealing directly with a person. In each, something that is less than conversation begins to seem like conversation. Venting feelings comes to feel like sharing them" {231}

    It seems to me that she is understating the benefits that unburdening can provide, and missing the long history of practices that surround the act, for good reason. There is more to unburdening than "bad feelings become less toxic when released", and more to it than a simple venting; it's just that what we seek is not always conversation. We should pay attention to gestures like Feynman's.

    • Aside: Unburdening and anonymity

      There is much talk about speech, anonymity and privacy on the Internet, but sometimes our ideas of speech and what it is for are too narrow and this steers the debate off the rails. Perhaps it's the information-centric view of dialogue as information exchange that blinds some people to the other purposes of speech, but acts such as unburdening need to be thought of differently. There is an idea (see Eric Schmidt's famous "If you have something that you don't want anyone to know, maybe you shouldn't be doing it in the first place", or Douglas Rushkoff in his recent "Program or be Programmed") that so long as we are honest with what we say, then privacy is not that big a worry. But it's not only stupid mistakes or criminal/offensive acts that we don't want out there in public, associated with our names. Unburdening is just one kind of speech that needs to be private for completely legitimate reasons, and that we need to be able to enter into knowing that its consequences are limited.

    What is conversation for?

    Perhaps, I wondered, unburdening is one form of conversation that doesn't need a full participant on the other end. The point is sometimes to hear ourselves speak. A friend of mine at work had a teaching assistant in a science lab class who said "you can ask me any question you want, but first you have to ask the bear". The bear was a teddy bear sitting on a filing cabinet. It was surprising, my friend says, how many students asked the bear their question, and then realised they didn't need to ask the teaching assistant.

    So then, why does it matter if it's a robot, a dog, a diary or a teddy bear on a filing cabinet if what we want is to just use speech to work out some problem or explore some emotion? Turkle writes "How can I talk about sibling rivalry to something that never had a mother?" {19} But a diary doesn't have a mother, and a dog doesn't understand what you are talking about, and people have used diaries and dogs to sort out sibling rivalry problems for centuries.

    Back to where I started

    So there I was, disagreeing with Turkle about authenticity and about conversation. Yet the more I think about it, the more I am coming round to agreeing with her (on the robots anyway), for a mixture of reasons.

    One is what I think of as the "postmodern mistake". Postmodernism takes things we think of as certain and shakes them up, showing us that foundations we thought were solid are in fact wobbly. But sometimes it leaps from "everything is uncertain" to "everything is equally uncertain" and that just ain't so. Is there a well-defined border between India and Pakistan? No, but we can still talk unambiguously about "India" and "Pakistan" despite that. A little fuzziness doesn't mean we have to abandon everything.

    So conversations with checkout workers are inauthentic, and conversations with robots are inauthentic, but that doesn't make them equally inauthentic. The limits of a robot are orders of magnitude more constrained than even the most robotic of phone-call workers. In "Everything is Obvious", Duncan Watts explains how Artificial Intelligence has been more challenging than its proponents believed because, in attempting to design intelligent machines, they failed to realize what was relevant. The fact that we are so ready to add meaning to robot actions will lead interactions rapidly into unexpected and problematic areas.

    Why am I so pessimistic that the interactions will be "problematic"? Because the robots we may see soon will be commercial products, and that means they will have an agenda. Rob Horning has the same worry about networks; in his final paragraph he writes "The problem is that we believe that we construct this social-media identity autonomously and that it is therefore our responsibility, our fault if it’s limited. The social-media companies have largely succeeded in persuading users of their platforms’ neutrality. What we fail to see is that these new identities are no less contingent and dictated to us then the ones circumscribed by tradition; only now the constraints are imposed by for-profit companies in explicit service of gain." In the same way that the algorithms of social networking sites have a straightforward agenda (keep us on the site, to maximize advertising exposure), so robots will have a straightforward agenda (cost effectiveness, keeping old people occupied, and so on) that will not be obvious to us as we interact with them.

    The other problem I see, which applies to networks and to robots, is their uniformity. People have their faults, but different people have different faults, and so humanity as a whole is not dragged down any single rabbit hole. The introduction of global communications media that have very specific (and limited) formats (the text message, the tweet) cannot but have a homogenizing effect on our interactions.

    But these conclusions are not so important, and I could be talked out of them. What's more important about the book is the unexpected avenues it leads you down. I'd rather have a book that prompts a week or two of thought than one that gives me the answers I'm looking for. I'd rather a book with the foibles of a human conversation than the reassuring, stress-free interactions of a robot, and Alone Together was such a book for me.

    I've screwed up the comments trying to move to Disqus so I don't have to deal with the 10/1 spam to real-comment ratio that Typepad lets through. Hope to have it sorted soon, when usual crappy service will be resumed.

    Alone Together 1: Stories

    [The first of a few reflections prompted by Sherry Turkle's Alone Together.]

    The sublime Leonard Cohen in today's Guardian:

    I don't really like songs with ideas. They tend to become slogans. They tend to be on the right side of things: ecology or vegetarianism or antiwar. All these are wonderful ideas but I like to work on a song until those slogans, as wonderful as they are and as wholesome as the ideas they promote are, dissolve into deeper convictions of the heart. I never set out to write a didactic song. It's just my experience. All I've got to put in a song is my own experience.

    The same is true of fiction. Songs and stories are powerful ways of communicating, but literature with an agenda is almost always bad literature, stories with a message are almost always shallow morality tales, and the fables that now pepper popular non-fiction books are often particularly egregious examples. Thomas Friedman's taxi drivers and Malcolm Gladwell's hush puppies are the 21st-century template for books on management, business, economics, politics, and technology only because even badly-told stories seduce us.

    Whenever I encounter a story in a non-fiction book my guard goes up, whether it's fictional or a retelling of an actual event. I know that I am being presented with a Trojan horse; there's a message hidden inside and the only reason for telling me the story is to sneak that message past my defenses of scepticism and logic. It's a trick, and critical readers must reject it. At some point the tables will turn and the telling of non-fiction tales will be recognized as the dishonest, slippery tactic that it is, but for now we must simply resist them and the invading armies that they are smuggling. Which makes it all the more surprising that I loved Sherry Turkle's Alone Together, because it is full of stories.

    More precisely, I loved the first half of the book, devoted to observing how humans react to robots that react to humans. In Part Two she observes humans reacting to other humans through the medium of digital networks and is less successful. Her use of stories is one reason why Part One works and Part Two fails, so lets stay with the robots and Part One for now.

    First, if you are going to use stories you might as well tell them well and Turkle does so. She has an eye for a telling phrase that sets her apart from most non-fiction writers. From a robot that "develops its own origami of lovemaking positions" to the titles and subtitles of the book, she coins phrases that evoke the contradictions and tensions that are her subjects. "Alone together", "The robotic moment: in solitude, new intimacies", "Networked: in intimacy, new solitudes".

    Second, the stories are not archetypes conjured up simply to illustrate a point, but emerge from the extensive observational work Turkle has done: more than 700 interviews over 30 years, decades of bringing robots to schools and nursing homes, sending them home with children for weeks at a time, watching participants interact with robots and watching herself also. "I think of the product as an intimate ethnography" she writes {xiii} and the credibility of the book comes from this longstanding and far-reaching work.

    More importantly, in Part One she uses stories to provoke questions, rather than to provide answers. Consider two examples.

    Early on, Turkle writes of visiting the American Museum of Natural History with her then-teenaged daughter Rebecca. They approach an exhibit of two giant tortoises from the Galapagos Islands. Rebecca looks at the one visible, motionless, creature and declares "They could have used a robot".

    Turkle was taken aback, and started a discussion with other parents and children in the line-up. Several of the children shared Rebecca's concern for the animal and her unimpressed reaction to its authenticity: it would be better for the tortoise itself not to have been brought all this way; a robot would not make the water dirty; "for what they do, you didn't have to have the live ones." The parents disagree: "The point is that they are real. That's the whole point."

    What I like is that the story does not deliver a message, but instead prompts questions in the mind of the reader. In this way, despite its factual origin, the story is more fictional/literary than many. Does authenticity matter? If so, under what circumstances, and why? It's the open-ended nature of the event that makes reading Alone Together an active, questioning experience, and one I found very rich.

    That's not to say Turkle doesn't have a message to deliver. She does, and she is clear enough about what it is: "I am a psychoanalytically trained psychologist. By both temperament and profession, I place high value on relationships of intimacy and authenticity." {6} The book is about Turkle's increasing concern, after years of enthusiasm, that social technologies are serving to erode these qualities.

    The second story is one that has stayed with me because it gets right to the heart of the issues the book raises around authenticity {74}. Visiting Japan in the early 1990s, Turkle heard tales of adult children who, too distant and too busy to visit their aging and infirm parents, hired actors to visit in their stead, playing the part of the adult child. What's more, the parents appreciated and enjoyed the gesture. It's slightly shocking to western sensibilities, but once we hear a little more context it becomes more understandable.

    First, the actors are not (in all cases, at least) a deception: the parents recognize them for what they are. Yet the parents "enjoyed the company and played the game". In Japan, being elderly is a role, being a child is a role, and parental visits have a strong dose of ritual to them: the recital of scripts by each party. While the child may not be able to act out their role, at least this way the parent gets to enact theirs, and so to reinforce their identity as an elderly, respected person.

    The story, again, provokes questions in the mind of the reader rather than leading us to a staged conclusion: questions about authenticity, when it matters, and why. Turkle's reaction was "if you are willing to send an actor, why not send a robot?" If it does not matter that the visitor is really a child does it matter if the visitor is really a visitor? Does it matter if the visitor is not really visiting (a phone call)? Or why, as my wife asked, should we see this as less than a visit when we could see it instead as more than a bunch of flowers?

    To me, the story and the questions it prompts undermine my confidence in my own judgements: to make me realise that they are more tied up with cultural conventions, more arbitrary and more shallow, than I thought. And if prompting reflection is the point, then that's OK because the story is, again, open ended: it is not hiding a pre-planned answer.

    Part Two of Alone Together fails because Turkle's interviews and observations focus on bringing out our discontents (new solitudes) with networking technologies. She has a message, and it's one we can either agree with or argue with, but by approaching this part in terms of discontents she fails to escape being didactic. The slogans have not dissolved, in Cohen's words.

    Part One succeeds because it explores the "new intimacies": what is surprisingly seductive about interacting with even the most crude and obviously artificial robots. It's this seduction that is so unsettling: the notion that things are "alive enough" for a given kind of relationship; that the most powerful thing a robot can do is to have needs which we can meet.

    There is something of a taboo against robots in Western societies. In the last few years we have grown to accept human-sounding artificial voices (the iPhone's Siri being the latest) but we shy away from artifical human appearance. We permit robots as toys and vacuum cleaners, but their use as companions for the aged or as visible service employees is still outside the realm of the every day (at least for now). Interacting with a visible robot is still a novel experience for those of us outside childhood, and so Part One of Alone Together has a sense of a report from a slightly alien future. What she shows us is how vulnerable we are to the seductions of even the most crude simulations, and for unexpected reasons, and the disquiet this provokes is something worth reflecting on. Taboos are vulnerable to suddenly being washed away, and the technological imperative may yet carry us forward into a world where robots are more commonly present. I share Turkle's concern about what impact that will have. More on that next time.

    Short Notes: Cute Cats (or not) in Central Asia

    Doing some reading after up my recent post on Ethan Zuckerman's "Cute Cats" talk I came across this post by Sarah Kendzior at registan.net. I know roughly nothing about the places and events she discusses, but it is a fascinating post by an obviously knowledgeable person, and the comments thread following it is one of the most absorbing I've ever read. Lots of people have great things to add, and they do so in a constructive and generous way.