I agreed to give a keynote address at the 21st Century Transmedia Innovation Symposium (www.21ctis.or.kr/). Traditional dictionaries do not include the word “transmedia,” but Wikipedia does. Its definition introduced me to many other words that neither I nor my dictionaries had ever before heard (for example, “narratological”). Strange jargon aside, I do believe there is an important idea here, which I explore in this column. (Intelligent discussions can be found in the books and articles of Henry Jenkins [1,2]).
We live in exciting times. Finally, we are beginning to understand that pleasure and fun are important components of life; that emotion is not a bad thing; and that learning, education, and work can all benefit from pleasure and fun. Up to now, a primary goal of product and service design has been to provide useful functions and results. We should not lose track of these goals, but now that we are well on our way to doing that for an amazing variety of goods and services, it is time to make sure they are pleasurable as well. Not only does this require emotions to be a major component of design thinking, but we must also incorporate actions; actions that use the whole body in movement, rhythm, and purpose.
In the bad old days we learned that thinkingcognitionwas king; emotion was bad. We were encouraged to memorize, to study, to think in words: reading, writing, and arithmetic prevailed.
But that is not how people have evolved. We are living animals, creatures with bodies, with legs and arms, eyes and ears, the ability to taste and smell, vestibular and feeling systems. We use our bodies to understand the world. We learn from concrete experiences, not from abstractionsabstraction comes last.
Games are the natural way we explore the world. Modern games are engaging, entertaining, and filled with learning experiences. They require thinking and acting, cognition and emotion, body motion and mental creativity. Games ought to be how we learn in school. Teachers should learn along with students. If cognition is about understanding the world, emotion is about interacting with it: judging, evaluating, and preparing to engage. The key term here is “engagement.”
Transmedia, on the other hand, is a strange beast. It comes from the world of commerce, where different people and companies used to own different parts of our experiencecorporations, companies, profit making, and ownership. Transmedia today is the new emergence of multiple media in common pursuit of a story or experience. It mainly speaks of how companies tie together movie releases with videos, games, books, and websites. Blogs and tweets, social networking, and telephone calls. Yes, this is a clever use of multiple media, but it is still based upon a distorted view of commerce: We make it, you consume it. The media moguls think of this as a one-way transmission: They would have their companies producing, with everyday people consuming. Why the asymmetry? We should all be producers. We should all have a say in what we experience.
My form of transmedia has nothing to do with companies and formal media channels. It has everything to do with free, natural, powerful expression. Let transmedia stand for those multisensory natural experiences: trans-action, trans-sensory. Let it stand for the mix of modalities: reading and writing, speaking and seeing, listening and touching, feeling and tasting. Let it stand for actions and behavior, thought and emotion.
There is another side of this new transmedia: co-development, co-creation, co-ownership. In this new world, we all produce, we all share, we all enjoy. Teacher and student learn together achieving new understanding. Reader and writer create together. Game player and game developer work together. This is the age of creativity, where everyone can participate. Everyone can be a designer. Everyone can be involved.
The personal computing revolution has been both liberating and restricting. We have gained access to powerful technologies for communicating with one another, for creating art, music, and literature. Everyday people could now do extraordinary things. At the same time, we became trapped by the confines of a keyboard, mouse, and screen. Instead of actively engaging the world, we spent our days in front of keyboards and screens, typing and pointing.
Today we are moving beyond the constraints of the mouse, screen, and keyboard. Now we can merge all the benefits of the information revolution with the benefits of movement and activity. We can post notes on buildings where only the intended receiver can see them, or we can let everyone see them, whatever we wish. We can play games or hold meetings with people all over the world, moving, gesturing, and acting.
Products were once designed for the functions they performed. But when all companies can make products that perform their functions equally well, the distinctive advantage goes to those who provide pleasure and enjoyment while maintaining the power. If functions are equated with cognition, pleasure is equated with emotion; today we want products that appeal to both cognition and emotion.
Consuming versus Producing: Spectator versus Creator
There is a major difference between the experience of consuming and producing, or if you will, between being a spectator and being a creator. In the traditional view of media, most of us are consumers. Artists and companies produce, while the rest of us consume. We are spectators.
There is nothing the matter with being an audience member, a consumer, or a spectator. It is how we have come to enjoy the great works of art and literature. We go to galleries to view, theaters to watch, libraries to read. We can be casual or engaged, watching from a distance or becoming deeply embedded in the events of music, opera, a painting, a video, or a book. We can become emotionally involved, weeping or laughing as the scenes unfold.
But there is a great difference when we are actually engaged in the activity, whether as producer, participant, or creator. When playing a musical instrument, I am producing, and all the senses are involved. I feel the sound pulsating through my body. My mind is completely engaged with the music, not only with the emotional aspects and the sound, but also with the physical and cognitive complexities of the mechanics of playing. To me it is simultaneously frustrating and pleasurable. To the listeners, it is probably awful, but I am not playing for them; I am playing for myself.
New technologies allow creativity to blossom, whether for reasons silly or sublime. Simple text messages or short videos qualify as production, regardless of their value. This new movement is about participating and creating, invoking the creative spiritthis is what the transmedia experience should be about.
The same holds true for the objects of our lives. We can purchase them in stores, bring them home, and either display or use them. They may give pleasure. But contrast this with objects that we ourselves have created or, perhaps, co-created.
Consider the old story so beloved in marketing 101 courses about the invention of cake mix. When the Betty Crocker Company first introduced a cake mix, so the story goes, it was supposed to revolutionize the making of cakes. Instead of toiling for hours, one had only to open the package of mix, add water, and bake. The result was a simple, satisfying cake. But the product was not a success. Housewives (at the time, the target audiencecollege students and single people were not then considered a market) rejected it. After a bit of market research, the Betty Crocker Company realized that they had made the mix too simple: There was no pride of ownership. The cake could have been purchased at a store. It tasted fine, but it wasn’t truly made at home, even if it was baked at home.
The solution was to modify the recipe to require the addition of an egg. This worked: Sales soared. Requiring a bit of extra labor gave the cook some feeling of accomplishment, a feeling of being the producer.
Today a reasonable number of products are designed to require work and effort on the part of their possessor. The purchaser must assemble IKEA furniture. Harley-Davidson aficionados often customize their motorcyclesmany take their bikes straight from the dealer to the custom house, and even though they do not do the customization themselves, they spend considerable time and thought specifying just how the finished bike should look and behave. Similarly, many home electronics can be customized with “skins,” adjustable features, add-on components, and hand-painted exteriors. So too with automobiles. One could argue that part of the popularity of social sites is that they are personal: One is sharing personal ideas and thoughts.
But how much of this is creative? How much requires commitment and concern, deep thought and effort? Most of this involves the simple following of instructions, whether for a cake or a chair. Or customizing an automobile by choosing among predefined options such as color and fabric. Adding an egg to a mix that didn’t really need one makes clever use of psychology, but it is not what I call being truly creative. The cake mix, with egg or without, is mindless. Read the instructions and follow them: Everyone’s mix produces the same result. Following instructions to assemble furniture does not qualify, but mixing and matching furniture parts to create something personal, something special does. So too with the customization of the Harley. Even though the customization is actually done by the specialists in the shop, the specification and design relate to the specific needs and aspirations of the bike owner. None of this is truly creative; none of this is truly meaningful.
Music mashups qualify. Here one takes samples of existing music and mixes them to create a truly novel experience. The result may sound awful or wonderful, but that is not nearly so important as the act of creation. The world of “DIY” or “make” relishes in creativity and imagination. Mashups work across all media, sometimes producing spoofs and satire, sometimes truly useful and valuable results.
Here is a simple example of a mashup that, although not profound, does reveal a sense of humor, creating a clever spoof of two very different events. The first event occurred during the televised presentation of an MTV Video award. Just after one award had been announced, Kanye West jumped on to the stage and interrupted Taylor Swift’s acceptance speech to complain that a better performer, Beyoncé, had been passed over. The second event was a major speech on health care by President Obama to the United States Congress. Obama’s speech was interrupted by a congressman who shouted, “You lie!” An enterprising mash-upper recognized the similarities of the two incidents and quickly combined components of the two videos so that the complaint about Beyoncé was inserted into President Obama’s speech. As a result, now one can watch president Obama delivering a speech on health care with a heckler interrupting to say, “Imma let you finish, but Beyoncé had one of the best videos of all time!” to which Obama calmly responds, “Not true.” That is mashup as satire. Mashups don’t have to be satirical, of course: When someone takes census data, overlaps it with police reports, and enters all on to a city map, that is mashup with meaning and import.
Good games can also create meaningful participation, meaningful experiences. Whatever the form of gameathletics and sports, cards, board games, video, or computerthe players are simultaneously creating the experience. Perhaps this is why they are so engrossing. They provide a transmedia experience in which people are simultaneously spectator and performer, and in the case of many games, using all of the senses, all of the body.
New technologies allow creativity to blossom, whether for reasons silly or sublime. Simple text messages or short videos qualify as production, regardless of their value. This new movement is about participating and creating, invoking the creative spiritthis is what the transmedia experience should be about. All of these experiences allow people to feel more like producers and creators than passive consumers or spectators.
The Design Challenge: Active, Participatory Transmedia
Transmedia experiences are not particularly new. Consider an opera, a musical comedy, a Hollywood (or better, Bollywood) extravaganza, or an amusement park. All of these experiences cut across mediasight and sound, motion and emotion. But all of them involve a transmitter of the experience and a passive audience.
Creation is not new. Artists and craftspeople create. Amateur artists and musicians create. Game players create. But in all of these activities, there are still creators and viewers. Moreover, the creativity is often limited, much as it is limited in so-called “personalization” of software or IKEA furnitureit is limited by the desires of the manufacturer. What is needed is meaningful, thoughtful creation and participation.
Jon Kolko examined this point in a thoughtful essay in this magazine . Assembling IKEA furniture is not a display of creativity, nor are any of the standard selections of items from a menu that go along with simple personalization or customization choices offered by manufacturers or websites. A mindless tweet is not creative. True creativity requires some thought, some work, some effort. It has to be reflective, even if only after the fact. Mindless creativity has its place, but the real challenge before us is to unleash the substantive creativity inside most people.
The new design challenge is to create true participatory designs coupled with true multimedia immersion that reveal new insights and create true novel experiences. We all participate, we all experience. We all design, we all partake. But much of this is meaningless: How do we provide richness and depth, enhanced through the active engagement of all, whether they be the originators or the recipients of the experience?
How will this come to pass? What is the role in everyday life? Will this be a small portion or will it dominate? Will it even be permitted within the confines of contemporary commercialism? Those are the significant design challenges.
1. Jenkins, H. “Transmedia Storytelling: Moving Characters From Books to Films to Video Games Can Make Them Stronger and More Compelling.” Technology Review (2003); http://www.technologyreview.com/Biotech/13052/
Don Norman wears many hats, including cofounder of the Nielsen Norman group, professor at Northwestern University, visiting professor at KAIST (South Korea), and author. His latest book is The Design of Future Things. He lives at jnd.org.
©2010 ACM 1072-5220/10/0100 $10.00
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.
The Digital Library is published by the Association for Computing Machinery. Copyright © 2010 ACM, Inc.