Hugh Dubberly, Paul Pangaro
Interaction describes a range of processes. A previous "On Modeling" article presented models of interaction based on the internal capacity of the systems doing the interacting . At one extreme, there are simple reactive systems, such as a door that opens when you step on a mat or a search engine that returns results when you submit a query. At the other extreme is conversation. Conversation is a progression of exchanges among participants. Each participant is a "learning system," that is, a system that changes internally as a consequence of experience. This highly complex type of interaction is also quite powerful, for conversation is the means by which existing knowledge is conveyed and new knowledge is generated.
We talk all the time, but we're usually unaware of when conversation works, when it doesn't, and how we can improve it. Few of us have robust models of conversation. This article addresses the questions: What is conversation? How can conversation be improved? And, if conversation is important, why don't we consider conversation explicitly when we design for interaction? This article hopes to move practice in that direction. If, as this forum has often argued, models can improve design, we further ask, what models of conversation are useful for interaction design?
We begin by contrasting "conversation" with "communication" in a specific sense. We then offer a pragmatic but not exhaustive model of the process of conversing and explore how it is useful for design.
Claude Shannon developed a rigorous model of a transmission channel used to convey messages between an information source and a destination. While his context was analog telephones with wires highly susceptible to noise, Shannon produced a model that applies to a wide range of situations.
In Shannon's model an information source selects a message from a known set of possible messages, for example, a dot or a dash, a letter of the alphabet, or a word or phrase from a list. Human communication often relies on context to limit the expected set of messages. If you receive a call from a friend (the source) arriving by train, you expect to hear "I'm getting on the train," or "I'm on the train," or "the train is late," and so onmessages that are drawn from a set of possibilities known to both of you. The channel is effective if it enables you (the destination) to select which of the possible messages is currently being transmitted. (Voice communication is more than sufficient for this, and Shannon's interest was highly encoded transmission. But this simplified example draws useful distinctions for the discussion that follows.)
Communication in the sense of distinguishing among possible messages known in advance is important for much of our daily life. It allows us to synchronize a wide range of actions with others. But it has limits. Shannon's model captures a fundamental limit of nearly all human-to-computer interaction: Our input gestures can only activate an existing interface command (select a message) from the preprogrammed set. While we can automate sequences of existing commands, we can't ask for something novel. If our software application does anything novel, we file a bug report!
In Shannon's model, how can we say something novel to one another? The answer is, we can't. It's not designed for that. We need the capacity for new messages to be generated and the resultant understanding confirmed or denied. We call interaction with these capacities "conversation." Only in conversation can we learn new concepts, share and evolve knowledge, and confirm agreement. To describe how this works, we draw on the efforts of Gordon Pask, specifically his cybernetic models of conversation theory, because they are based on a deep study of human-to-human and human-to-machine interaction and because of their prescriptive power .
Conversation at its simplest takes place when participants perform these tasks:
- Open a channel. When participant A sends an initial message, the possibility for conversation opens. For conversation to follow, the message must establish common ground; it must be comprehensible to participant B.
- Commit to engage. Participant B must pay attention to the message and then commit to engaging with A. Such a commitment may amount to nothing more than continuing to pay attention. For conversation to persist, the commitment must be symmetrical, and either side may break off for any reason, at any time. Put another way, each participant must see value in continuing the conversation, which offsets the personal cost of being engaged; what we call the "bio-cost," or the energy, time, attention, and stress required .
- Construct meaning. Conversation enables us to
construct (or reconstruct) meaning, including meaning that is new
to the destination. Conversation theory has a highly detailed
model that we must leave to other descriptions though it is
useful even in this skeletal form .
Messages are composed with topics or distinctions that are already shared, on the basis of prior conversation or shared contexts, such as common language and social norms. Participant A uses the message channel to convey what these topics are and how they are distinct from one another (descriptive dynamics), along with a kind of "glue" that explains just how these topics interact to make up the new concept (prescriptive dynamics). Participant B "takes all this in" and "puts it all together" to reproduce A's meaning (or something close enough).
This can occur because, first, the descriptive and prescriptive dynamics come together to express an inherent coherence for the conceptthey fit together like gears in a watch and only in a limited way or ways. Second, the human nervous system has evolved especially to make sense of the messages that arrive . This "meaning making" (taking all this in and putting it all together) is a mini AHA moment, every time we "get" what someone is saying .
- Evolve. Participant A or B (or both) are different
after the interaction. Either or both hold new beliefs, make
decisions, or develop new relationships, with others, with
circumstances or objects, or with themselves.
Here we define an "effective conversation" as an interaction in which the changes brought about by conversation have lasting value to the participants.
- Converge on agreement. Participant B may wish to confirm understanding of A's concept. To do so, B must create and transmit a different formulation of the topic(s) under discussion, one that captures his model of the concept. On receipt, participant A attempts to make sense of B's formulation and compares it with her original intention. This may lead to further exchanges. When both A and B judge that the concepts match sufficiently, they have reached "an agreement over an understanding." Such agreement may involve a fact about the world or merely shared belief. Sometimes participants agree on the qualities of a song, or that they like each other enough to continue talking.
- Act or Transact. Sometimes one or more of the participants agrees to perform an action as a result of, and beyond, the conversation that has taken place. For example, they may agree to play a game together or enter into a relationship. Or they may agree to an exchange, as when money is traded for a product or service.
Thus we have a simplified description of conversation. All of us experience breakdowns in conversations; it is near miraculous that we understand each other at all. But if you comprehend this, the process of conversation is working right now.
Conversation enables participants to:
1. Learn. We learn a great deal via conversation, including conversations with ourselves. We learn highly valuable life lessons, for example, ways to avoid being run over by a bus. At an opposite extreme, what we learn might seem simple: Our partner prefers drinking noncarbonated, roomtemperature water; registering a credit card on a website saves time when buying airline tickets. Trivial as these examples may seem, learning basic things may save time later, freeing our future attention for other, less trivial, things. This is a valuable benefit of interactions that have memory and that evolve into relationships.
2. Coordinate. We spend a great deal of time with others not merely synchronizing ("You've arrived, so let's start!"), but also coordinating our actions in ways that are mutually beneficial. Anytime we negotiate one favor for another, we use conversation to reach an agreement to transact:
Me: "I'll pick up the laundry if you stop for groceries,
You: "No, you have to take the car in for servicing."
Me: "I can do both, but you'll have to cook if you want to eat on time."
You: "That still works for me."
Me: "OK, good."
In practice, society is a complex market of coordination based in conversation. Money is often used in the transaction, but not always. Subsets of the population agree to perform some actions (grow food, manufacture products, educate children, enforce the law) paid for by others who are free to do what they do, for (hopefully) mutual benefit.
Individuals and society become more efficient by coordinating work. This frees resources for other activitiesincluding the design of more efficient products and services, in a recursive and generative processwhich supported the Industrial Revolution. Conversation is the primary mechanism for complex human social coordination. It is a highly effective form of bio-cost reduction and therefore an engine of society.
3. Collaborate. Coordination of action assumes relatively clear goals, but many times social interaction involves the negotiation of goals. (Horst Rittel believed this to be a fundamental challenge of design .) We may want to eat together, but one of us prefers Italian food, while the other doesn't want to spend too much or listen to opera while eating. Or, we need to redesign our Web service but have conflicting demands for features, quality of experience, and development time. Or we would like to see a more equitable health care system. Conversation is a requisite for agreeing on goals, as well as for agreeing upon, and coordinating, our actions.
When designing for conversation, it is critical to consider what cannot happen. What can't be talked about can't be learned, conveyed, agreed on, or transacted. Conversations may be limited in two fundamental ways:
1. Conversational infrastructure. We are frustrated when we can't open a channel for conversation or when the channel is full of noise (experienced by every U.S. mobile phone user). Or we're frustrated when we can't use the available interface functions to get what we want. So, when software is the connection between participants, we ought to ask, "How well does the infrastructure support the conversational connection?"
2. Conversational participants. Inherent in the capacities for a given conversation are the individual limits of its participants. Individuals contribute both what they know in depth and breadth and their style of interaction. Given a specific group of participants, conversations may go nowherethey have no value; they create no lasting change in the participants. Other conversations create their own energy and go placesthey are generative, have momentum, and lead to new and unexpected knowledge. We prize the individuals with whom we achieve this. When assembling a design team we ought to ask, "What expertise and what collaborative style(s) do we need? What variety is required to succeed?"
A human participant in conversation is usually a single person, although Pask suggests additional possibilities .
Conversations may take place between groups. For example, different political parties, religious groups, or nations interact with each otherthey send messages, commit to engage (or not), evolve each other's beliefs, and sometimes lead to transactions such as trade or war.
Similarly, we often have internal conversationsconversations with ourselves. I explore alternative perspectives, exchange points of view, come to a stable viewpoint about a belief or action (or, when I can't, remain conflicted)all inside my own mind.
We generate new ideas by combining old topics in new ways. This is important to interaction design because we spend so much time in front of screens talking to ourselves. Interaction design is as much about connecting humans across the murky "Internet cloud" (fostering community and conversation) as connecting an individual with his or her own capacity to explore what is possible and generate new possibilities (supporting internal conversations).
Conversation matters to any community of interest (including our community of a single mind), but nowhere is the value of conversation more clear than in commerce, because commerce cannot flourish, or even exist, without conversation.
But many products and services, on and off the Web, connect individuals for broader reasons. Social networks such as Facebook and LinkedIn match two ends of a channel for mutual benefit, whether or not money changes hands. Sometimes what occurs is a sharing of interests, ideas, or even intimacy. But in all these cases, conversation is required.
Summarizing, conversation is infrastructure for commerce because:
- Long-term success means ongoing commerce.
- Ongoing commerce needs ongoing trust.
- Ongoing trust is built via ongoing relationships.
- Ongoing relationships are built via agreeing on goals and actions.
- Agreeing on goals and actions is possible only through effective conversation. So, effective conversation is essential to commerce.
If conversation is important to "users," we should explicitly model conversation as we design. Here are four broad proposals:
View every user (persona) as a participant in a conversation, and every scenario as a conversation to define or achieve one or more goals. Use models of conversation to make design decisions, such as:
- What channel is being opened to begin the conversation? Is the interruption reasonable in how and when it intrudes? What is the bio-cost of the intrusion relative to its benefit? Are there better ways to interrupt?
- Is the first message clear? Does it offer something to the recipient?
- Once accepted, does the ongoing exchange convey the potential benefits in continuing the engagement? Is there learning or delight? Is curiosity or interest stimulated? At what bio-cost? How can it be improved?
- Is meaning easily understood; that is, do the messages speak to the participants' context, needs, interests, values, and in their language? How difficult is it for users to "put together"? How can messages be made more efficient or clear or entertaining, as appropriate?
- How can users convey intention and meaning to the software? Are those means sufficiently expressive or easy or delightful? Where do they fall short?
- Do participants evolve during the interaction? Aside from entertainment or delight, do they acquire something useful, learn a new point of view, or gain new knowledge? (This applies to human participants as well as software, which may evolve a model of the user for the sake of having more effective or more efficient conversations in the future.)
- Do both sides agree? Can the participants agree to disagree?
- Can sharing or exchange or transaction continue beyond this conversation, whether in the form of commerce or barter or simply agreeing to continue the conversation at a later time? In other words, has the conversation begun or continued a relationship?
Invest in a better understanding of conversation:
- Review past projects and recast them as conversations: How could design outcomes be improved?
- Look at new technologies or techniques in terms of conversation: Do they help generate more effective conversations?
- When developing new projects, do models of conversation help in choosing technologies or techniques?
- Can we design for conversations that directly improve trust, and therefore create stronger communities or greater lifetime customer value?
Investigate trends, tools, and technologies that will change online conversations in the next five years:
- Personal journeys: How do physical age and technology exposure change predilections for media, modes of collaboration, and personal values?
- Social computing: How will conversational technology transform individuals and organizations?
- Portable and secure identity tools: How do OpenID and equivalents create secure and controllable online identities? How do they build trust? What can't they do?
- Cloud computing: How can we deliver the same experience everywhere, at lower cost?
- Sensors: How does a seamless "network of objects," when capable of conversational interaction, better extend our capacity for learning, coordinating, and collaborating?
Invest in design of conversations via prototyping:
- For stakeholders: Build trust and value for employees, shareholders, clients, partners, competitors, and communities of interest.
- Inside the organization: Instill coevolution as the process for understanding the market, defining and delivering the offering, and increasing customer satisfaction and shareholder value.
- Across organizational and cultural boundaries: Explore a "marketplace of ideas."
Imagine a design movement that takes conversation seriously. Could it create a revolution?
The Industrial Revolution harnessed physical machines to extend and enhance our muscles. The Information Revolution harnessed virtual machines to extend and enhance our nervous systems. A "Conversation Revolution" would harness the existing infrastructure of physical machines and virtual machines to create a mesh out of "networks of objects" and networks of individuals and organizations. Such a mesh would enhance coordination and collaboration and create wealth by introducing new efficiencies. It would also expand opportunities to generate new knowledge.
Imagine a search engine designed for effective conversation, with all the knowledge on the Web participating. We would no longer be focused on "search," nor would we be using an "engine." What should it be called? Who will build it first?
2. For a general review of Conversation Theory, see Pask, G., Conversation Theory: Applications in Education and Epistemology, Elsevier Publishing Co., Amsterdam and New York, 1976. For a short explication of Pask's conversation structure, see <http://pangaro.com/L1L0/>. For Pask's experimental framework for interaction studies, see Pask, G., The Cybernetics of Human Learning and Performance, Hutchinson, London, 1975.
4. Pask, G., "An Essay on the Kinetics of Language, Behavior and Thought," Proceedings, Silver Anniversary International Meeting of Society for General Systems Research, London, August 1979. A summary of the knowledge model, called entailment meshes, is available at <http://pangaro.com/entailments/entailing-v2.htm> and video explanations of entailment meshes are available at <http://www.cyber-neticians.com/index.html#pan>
5. Von Foerster said, "The nervous system organizes the world to compute a stable state." Quoted in Pangaro, P., "The Past-Future of Cybernetics: Conversations, Von Foerster, and the BCL," Chapter 8 in Müller, A., and Müller, K. An Unfinished Revolution?, edition echoraum, Vienna 2007, page 9. Preprint download at <http://pangaro.com/HvF/hvf-bcl-abstract.html>
7. Pask, G., Scott, B. C. E., and Kallilourdis, D. "A Theory of Conversations and Individuals (Exemplified by the Learning Process on CASTE)," International Journal of Man-Machine Studies, 5, no. 4 (1973): 443566.
Hugh Dubberly manages a consultancy focused on making services and software easier to use through interaction design and information design. As vice president he was responsible for design and production of Netscape's Web services. For 10 years he was at Apple, where he managed graphic design and corporate identity and co-created the Knowledge Navigator series of videos. Dubberly also founded an interactive media department at Art Center and has taught at CMU, IIT/ID, San Jose State, and Stanford.
Paul Pangaro is the CTO at CyberneticLifestyles.com in New York City, where he consults at the intersection of product strategy, marketing, and organizational dynamics. He is recognized as an authority on search and related conversational impedances in human-machine interaction, and on entailment meshes, a highly rigorous framework for representing knowledge. He was CTO of several startups, including Idealab's Snap.com, and was senior director and distinguished market strategist at Sun Microsystems. Paul has taught at Stanford University.
Figure. Shannon's Model of Communication:
A message flows from an information source through a transmitter
that encodes a signal. The communication channel, shown as the
tiny square box subject to noise, conveys the signal to a
receiver, which decodes the signal into a message that is
delivered to a destination.
Figure. Conversation to Coordinate:
Participant B agrees to trade an action for payment from
participant A. B performs the action and confirms that his action
has created the correct result. A confirms her goal is achieved
and compensates B as agreed. Compensation may be monetary, return
of favor, barter, etc.
©2009 ACM 1072-5220/09/0700 $10.00
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.
The Digital Library is published by the Association for Computing Machinery. Copyright © 2009 ACM, Inc.