Conversation: Acting & Computers

On March 1, 2011 at 10:14 p.m., I posted the first draft of what will eventually become split into the Prologue and the fourth story in the “Making and Empathy” chapter in the book “Realizing Empathy: An Inquiry Into the Meaning of Making.” The story surrounded my experience observing a friend act the role of Blanche in a play called A Street Car Named Desire. While much has changed since then, I wanted to share with you an edited version of the conversation that followed, regrouped and rearranged for clarity and relevance. Click here for the previous installment, which also includes the introduction of the interdisciplinary participants of the conversation.

 

david: I think of it this way: great actors are not really actors, they are “be-ers.” They don’t play the role, they manifest the person encoded in the role, almost to the brink of no return. It’s very dangerous territory and quite a few of them have wound up in mental institutions.

Role-playing implies expectations on reality. What’s great about great acting? The notion that our expectations are up-ended. If all the actor does is establish believability, they haven’t really succeeded, because at some point, they’ve got to go over the edge, else it would be a very boring presentation.

slim: Yes, your critique on believability not being the goal is significant. I am curious if that at all relates back to programming. We write code and expect it to produce the same results every time we run it. Not only that, but we also want others who read the code or install it on their computer to believe this to be true as well.

But the reality is that the circumstance in which the program runs changes. For example, the hardware running the code may have different capacity for memory, the memory may be filled in different ways, the hard drive has a different capacity, the power supply has different capacity, the processor, there may be other software running at the same time. The reality is much messier.

Yet programming language designers just keep abstracting all that physical reality away. Trying so hard to make it believable that the virtual machine is the real machine (e.g., Java).

david: In my opinion, nothing has done more to destroy computer science education in this country than Java.

I’d like to point out further, that what lies at the center of actors and musicians, generally, and great artists more broadly, is an ability to be present without expectations of the future or nostalgia for the past. What’s weird — and this gets into the metaphysics of quality à la Pirsig — is that, in my opinion, you can feel this presence, but there is no metric for it. That’s what makes us human.

The Eastern concept of duality rears its ugly head in this story on several occasions, and I would suggest that you might as well label it, and dive into it a little, though it’s a book unto itself. This concept resonates through a lot of what you are saying, meaning that it is another perspective on empathy. The perspective you are presenting is inherently dual, as opposed to moving toward a concept of singularity. Again, metaphysical.

slim: I hesitate to frame this as the Eastern duality. Maybe it’s a choice of words or my misinterpretation of what you mean, but I think of it as circularity as opposed to duality. Imagine a constant movement along
a continuous domain. When you stop along the path and look from any given vantage point you consider what you see to be the other —something outside of yourself. But as you move along that path, as you try to empathize, you eventually feel as if you are that other.

This is what actors do, but all they might have is a piece of script — which is just a bunch of words and some simple directions. So we have to figure out what the script actually means, from our own experiences. We have to first translate it, then interpret it. The same goes for playing from sheet music or learning how to dance. We can’t learn how to dance just by watching how the choreographer’s limbs move. We also have to find out where the invisible force is acting inside the body of the choreographer.

A friend of mine did a beautiful performance piece that speaks to this idea of meaning vs. form. She first filmed herself drawing a circle. Then she projected the film on a surface, and filmed herself again, but this time tracing her movement in the film. She would repeat this over and over, each time tracing the movements of the previous recording of herself tracing the previous recording. Each time, the shape of the circle gets more and more distorted. Eventually what gets drawn doesn’t resemble a circle at all.

In essence, the “why” of the movement gets lost, and all is left is the superficial. To have been able to draw a circle, you have had to understood why the first drawing was manifested the way it was. And once you have that understanding, you might not even draw a circle, but paint one instead. That is the kind of understanding that can only result from having tried to empathize.

jeff: Practically speaking, though, I think there are limits to empathy. For some things, you really either need a sliver of experience or some non-obvious knowledge that helps you imagine the other perspective.

slim: I think so, too. What experiences did you have in mind?

jeff: Like parenting. If you have a dog, you probably have developed a different level of patience than someone who has never tried to train a pet — or anything for that matter. Someone who has never been in a serious accident, catastrophe, combat, or other very dangerous situation probably has no idea what it means for “time to slow down” or “it happened so fast.”

A similar problem arises when people talk about spiritual or religious experiences. Some people may regard spirituality as “we are all connected somehow” or “there is some higher order in the universe.” My concept of this is “all things are connected (sort of)” but there’s nothing mystical about it because we already know we live in the same universe, but to feel it and really empathize with it and think about everything that is happening all the time, is a different concept.

When dealing with Christianity, I have always been puzzled by the idea of “God speaks to us all.” Is that what is actually happening in experience or is that metaphorically true — as in God is the universe? To even get a grasp on that, I’ve found it never makes any sense to consider Christianity from my perspective but as a box unto itself. And I may also have to consider that it is impossible for me to understand simply because I am me and not having those experiences. Perhaps God only speaks to Christians ,  which would make a ton of sense. And then there is the complication that faith is belief in precisely what does not make sense.

slim: I think a significant part of what you’re talking about has to do with language. Depending on what words you use to describe your experience, it could conjure up different experiences in different people, and unless people are willing to establish a shared language in the context of the conversation, more often than not people are not having
a meaningful conversation.

So when you say you don’t have the experience to know what Christian phrases mean, there’s also a chance that you do have the experience but you don’t use the same words used by the Christians to refer to it, which causes miscommunication, and misunderstanding.

jeff: Maybe. Although, I recently finished an excellent audio-book, Amusing Ourselves to Death by Neil Postman. He argued that the form of the media affects how we conceptualize the world so deeply that we are often not aware of how it changes us or how we are different from people in times past. Can we understand what it might be like to live in a society with no print? Or pre-television America, where people would pay money to hear authors read their books from lecturns and people would debate in a language that resembled printed prose rather than the plain-speak we use today.

Similarly, Facebook and Twitter afford relatively short updates and lend themselves to trivialities because it’s become so easy and considered non-imposing to spit out snarky one-liners to friends without considering their context (because it is unavailable). And on a blog, when someone is writing a really long reply, they can’t tell whether they’ve jumped too many topics and have lost their readers completely, because the others won’t see the post until after it’s been posted. So perhaps the rise of writing in society due to the Internet can lend itself to an egotistical style of communication, by the very nature of what the medium is.

slim: Well, I don’t find writing to be a particularly egotistical style of communication, but that of course depends on what you mean by “egotistical” and what you mean by “writing.”

I think it’s the space — I don’t just mean physical or even virtual space, I mean the feeling of space or the relationship between and among participants of interaction — in which the writing is presented can make a writing  egotistical or not egotistical.

Do you really think the nature of the medium affords a egotistical style of communication? The reason I ask is because I’ve had in-depth, thought-provoking discussions about a variety of topics that stem from just a status update on Facebook. So I’m not yet convinced that the nature of the medium somehow absolutely dictates an egotistical style of communication.

Or maybe what you mean is that it isn’t designed with the goal of facilitating a non-egotistical style of communication, and so it’s likely that many people default to something that takes less effort, which is the “egotistical style”? Am I understanding you?

an-lon: A quick note about Internet communities. The type of negative behavior Jeff described — picking fights and baiting and snark — reminds me a lot of people in their cars on the freeway. It’s as if you’re in a bubble and the usual rules don’t apply. I don’t doubt that some of the asshole drivers out there would be perfectly civil to each other in real life, where feedback is instantaneous and actions don’t go without consequences. Such is the power of anonymity.

That said, the Internet doesn’t have to be that way. In a different thread, I described how one very early Internet community evolved from the fan site of an author who was way ahead of her time :  Torey Hayden.1 One thing she had to police in her bulletin boards was language.  People were absolutely not allowed to write like Internet chimps.

The reason was that it was an international board, and she insisted that native-English speakers use proper grammar, punctuation, and capitalization in order to make it easier for the non-native English speakers to understand. Obviously, the non-native English speakers were just asked to do their best. The point wasn’t to punish people for poor English grammar per se, it was to punish lazy and avoidable misuse of the English language.

I really think the language rule made a huge difference not just in what people said, but in how they thought. It reminded them that they were holding a conversation, and that there were people on the other end who might carry with them a vastly different set of cultural assumptions and values.

The other notable feature of the message board was that it was predominantly female in an era when that was still fairly rare. The result was an extremely active and close-knit community that debated and joked about everything under the sun.

People did use avatars and screen names, and were anonymous in that sense, but in general, there wasn’t the kind of mindless hit-and-run you see in, say, the comments section of a New York Times article about politics. I only ever lurked, but for regulars it was a level of addictiveness decades before Facebook. Rather sadly, that’s where the author recently migrated her site.

Her message board had been a significant time commitment for her maintain, as it was pretty much the force of her personality and the ground rules she established that kept the board civilized. Eventually, she decided that the technology that had been cutting-edge when she created the board was hitting obsolescence, and that Facebook was an easier way to interact with her fans and keep the same conversations going.

I think what I’m saying is that there’s a bit of a founder effect2 to Internet communities. If the pioneers are assholes, everyone thinks they have a right to be an asshole. If there’s a precedent for civility, newcomers can learn to be civil too.

And there’s also no inherent reason for Facebook to be as shallow as it often is. The only reason I’m even here is that when Slim started posting substantive status updates to Facebook, I started writing substantive replies.

slim: Jeff, I think you’re saying that when left to our default vices, the way in which Twitter, Facebook, and other social media sites have been designed can direct us toward a certain kind of communication. Some of the reasons why include the fact that it makes the content seem context-free, which leads to misunderstandings, people making assumptions, passing judgments, or being downright malicious for the fun of it, as opposed to contemplating the meaning behind the content or asking a questions in order to further understand and empathize. Please correct me if I am misunderstanding.

jeff: All I’m saying is that the medium does affect how we think. Comparing writing to speech, reflection and revision makes it easier to achieve coherence. I refer to writing as most people encounter it, through online arguments in basically public forums where people don’t know each other. A person needs to make some assumptions about the person they are trying to convince — or more likely, put down. You also can’t confirm your assumptions as you can in person. Most people who argue online don’t follow the argumentative Principle of Charity.3 It’s much harder to be careful and empathic instead of being abusive. Being abusive can also be fun.

And by written communication, I was also referring to short updates like Twitter and Facebook. Those are almost inherently egotistical, not necessarily bad or harmful, but in the sense that the communication has to start with a motive within. Things appear context-free and then you get inappropriate snarkiness.

an-lon: To get back to your story in the acting class, though, isn’t this the human condition in a nutshell? When listening, I seek to be transparent. When projecting, I seek to be saturated. But the “I” remains.

slim: I resonate with those pairings. It directly maps to the pairing I have in mind, which is humility and courage. Can you say more? I would love to hear what you have to say about them.

an-lon: Well, exasperatingly, this was always a visual image first, words second, and an analytical dissection, last. The poem below4 is what planted the image in my head.

If thou couldst empty all thyself of self,
Like to a shell dishabited,
Then might He find thee on the Ocean shelf,
And say—“This is not dead,”—
And fill thee with Himself instead.

But thou art all replete with very thou,
And hast such shrewd activity,
That, when He comes, He says—“This is enow
Unto itself—’Twere better let it be:
It is so small and full, there is no room for Me.”

I am not a religious person, and perhaps not spiritual so much as simply omnivorous, but I had an odd sense from the minute Anson introduced himself that the theologian’s viewpoint was important. Perhaps because there are concepts here that can be expressed no other way, except in the language of the sacred and divine? Certainly, the theme of humility comes into play with this poem.

Anyway, the words “replete with very thou” have been part of my internal monologue since forever — whenever I realize I’m getting in my own way of understanding someone else’s viewpoint.

As for being saturated in order to project, exaggeration is the lifeblood of animation. The illusion of life is precisely that — an illusion. Whether the action in question is a walk cycle or a line of dialogue, you can’t just copy what happens in real life. You have to find the essence of what it is, amplify that, and filter out the rest.

Same with drawing caricatures. It’s not enough to simply give a guy a big nose, you really have find the essence of someone’s facial features and amp that up.

The image in my head was going into Photoshop and cranking up the color saturation of an image, but the metaphor it represents is the exaggeration that is one of the pillars of character animation.

slim: I’m intrigued by what you said about exaggeration and animation.

Is there a degree of exaggeration that is appropriate? In other words, could it be over-done? Where is this need for “amplification” coming from and where is it going? Is the kind of exaggeration you’re talking about related to generating interest in the eye of the viewer? Or is it functional (i.e., if you don’t exaggerate it doesn’t look real)? Or all of the above? Is this really about saturation or contrast?

I know nothing about animation to have any insight into this.

an-lon: Exaggeration is one of the 12 Principles of Animation,5 as developed by Disney during their golden age. If you’re curious, I’d highly recommend a look at the first chapter of The Illusion of Life by Frank Thomas and Ollie Johnston. This is pretty much the Bible for anyone studying animation today, but it’s gorgeously illustrated and extremely readable for a general audience as well.

Here’s the intro paragraph to the “Exaggeration” section:

There was some confusion among the animators when Walt first asked for more realism and then criticized the result because it was not exaggerated enough. In Walt’s mind, there was probably no difference. 

He believed in going to the heart of anything and developing the essence of what he found. If a character was to be sad, make him sadder; bright, make him brighter; worried, more worried; wild, make him wilder. 

Some of the artists had felt that “exaggeration” meant a more distorted drawing, or an action so violent it was disturbing. They found they had missed the point. When Walt asked for realism, he wanted a caricature of realism.

In answer to your specific question of “can it be overdone?” It’s surprisingly difficult to overdo the exaggeration within a drawing, if it’s going in the right direction. If the exaggeration is just going in a random direction, it looks gross and distorted almost immediately, but if it’s going towards rather than away from the heart of the action, you can get away with a really surprising amount of distortion before it falls apart.

A lot of times, we’re given the advice to “push” the pose till it breaks and then back off, rather than inching incrementally toward that imaginary breaking point.

And “is it functional (i.e., if you don’t exaggerate it doesn’t look real)?” Yes, absolutely. Rotoscoping (tracing) live action reference frame by frame almost always comes out looking strangely dead. It takes a human eye to amplify the important parts and tone down the unimportant parts, even when the goal is to be completely unobtrusive about it.

Exaggeration is in pretty much every frame of any animated movie, 2D or 3D. The 12 principles are all so fundamental, they’re in every shot. Sometimes it’s subtle, as it has to be with the handsome prince or the beautiful princess, and sometimes it’s wildly exaggerated, as with the crazy animal sidekicks, but it really is the lifeblood of animation.

When I was first talking about saturation and contrast, it was just at the level of metaphor. What I’m talking about now, you can see in the roughest of pencil tests without any color.

——

1 Torey is the author of three novels, eight non-fiction books about her experiences working with troubled children and two children’s books. In a writing career that has spanned more than three decades, her books have been worldwide best-sellers, translated into more than 35 languages and appearing as films, stage productions, an opera, and even Kabuki theatre. (Hayden, “The Official Torey Hayden Website”)

“The Official Toery Hayden Website,” Tory Hayden, accessed January 19, 2013, http://www.torey-hayden.com.

2 In genetics, the Founder Principle is a principle whereby a daughter population or migrant population may differ in genetic composition from its parent population because the founders of the daughter population were not a representative sample of the parent population. For example, if only blue-eyed inhabitants of a town whose residents included brown-eyed people decided to found a new town, their descendants would all be blue-eyed. (Encyclopædia Britannica Online)

Encyclopædia Britannica Online, s. v. “Founder Principle,” accessed December 29, 2012, http://www.britannica.com/EBchecked/topic/214776/founder-principle.

3 The Principle of Charity is a methodological presumption made in seeking to understand a point of view whereby we seek to understand that view in its strongest, most persuasive from before subjecting the view to evaluation. While suspending our own beliefs, we seek a sympathetic understanding of the new idea or ideas. We assume for the moment the new ideas are true even though our initial reaction is to disagree; we seek to tolerate ambiguity for the larger aim of understanding ideas which might prove useful and helpful. Emphasis is placed on seeking to understand rather than on seeking contradictions or difficulties. We seek to understand the ideas in their most persuasive form and actively attempt to resolve contradictions. If more than one view is presented, we choose the one that appears the most cogent. (Oriental Philosophy, “The Principle of Charity”)

“The Principle of Charity,” accessed January 19, 2013, http://philosophy.lander.edu/oriental/charity.html.

4 The poem is called “Indwelling” by T. E. Brown. (Brown, “Indwelling”)

“Indwelling,” accessed December 28, 2012, http://www.isle-of-man.com/manxnotebook/people/writers/teb/p082b.htm.

5 12 Basic Principles of Animation / Squash and stretch/ Anticipation/ Staging/ Straight ahead action and pose to pose/ Follow through and overlapping action/ Slow in and slow out/ Arcs/ Secondary action/ Timing/ Exaggeration/ Solid drawing/ Appeal (Thomas, 1981, 47–69)

Conversation: Empathy & Computers

On February 22, 2011 at 4:48 p.m., I set up a private blog, where I could regularly engage in conversation with a group of friends from across disciplines. The process was to work as follows. I would post a piece of writing on the blog, they would comment on it, then based on their comment, I would not only revise the writing, but also feel encouraged and inspired to keep writing.

The outcome of the conversations was the book “Realizing Empathy: An Inquiry Into the Meaning of Making,” which was successfully kickstarted on March 12, 2012. While much has changed since then, with their permission, I would like to share with you an edited version of several of those conversations with you, regrouped and rearranged for clarity and relevance. Here is the first installment.

 

an-lon: Chan1, can you start with a round of introductions? Who are they, the people reading this blog? How do they know you?

me: Oh, of course! Yes, let’s do that. Perhaps we can say what we do—not what our titles are—what our interests are, and where we are coming from. I think this will do wonders in enriching the conversation.

And before I forget, I just wanted to sincerely thank you all for participating in this journey of book writing. The past two-and-a-half years have been a time of divergence. It was time I desperately needed to get away from my previous environment, to find new ways of thinking.

In retrospect, the question I was ultimately after was the question of what makes us human. Much like the pioneers of computer science, I started wanting to understand better how “thinking” works, what “consciousness” is, how we “learn,” how we “understand” something, and what intelligence means. But unlike some of these pioneers, I was not interested in asking how we can abstract the “humanness” from ourselves, to disembody it, so as to put it in some other body, and to debate whether that other being is also human. Honestly, I can’t see why this line of questioning is valuable. What this kind of disembodied attempt at manifesting humanness can do, at best, is superficially mimic or simulate what one may mistakenly believe a human being to be, without any real understanding of what it actually means to be human.

At the same time, I had a deep attachment to the computer. In my professional life, I have spent a significant portion of my career programming the computer. In this process, I have often found myself totally immersed in thinking from its perspective and not mine. I would dare say that I empathize with it. Yes, I know that most of us think we only empathize with living beings. But from my experience at the Rhode Island School of Design (RISD), I’m starting to question this assumption. Because I’ve discovered many similarities between the process of trying to empathize with human beings, with that of trying to make physical things. And that’s precisely the vantage point from which I will start to write.

As I wrote in my e-mail invitation to you, my goal is to write in the company of a handful of people I feel comfortable sharing my ideas with. I then hope to get feedback, revise, and eventually integrate everything into my thesis book, which I will produce for graduation.

I would absolutely love it if you all could be candid about giving me feedback. I will inevitably make some strong statements that may seem controversial. I expect counter arguments and tangential references. I firmly believe that it is from the experience of contrasts, of seemingly unrelated or different experiences where new ways of thinking can arise. With that, I now pass the mic to you all. Thanks!

joonkoo: I thank you for inviting me to this very interesting forum of discussions. I don’t know how many are here, but let me start with the mic. I’m Joonkoo Park. I know Seung Chan hyung2 from high school. I went to the International School of Beijing (ISB) in 1994  to  1997. I’ve always been proud of Seung Chan for his free-minded spirit. He does what he wants to do and he does it well. So I was really glad to hear that he decided to study fine arts. And it looks like that was a real success. I was glad to join this discussion since I wanted to do anything to help him organize his thoughts and formulate ideas.

I study cognitive neuroscience of high-level vision. I am in the final stage of my Ph.D. at the University of Michigan. Most of my work is centered around neural organization and mechanisms of object recognition, such as faces, letters, and numbers; however, I’m getting more interested in numerical cognition, and I am planning to study the neural basis of number sense during postdoc.

That said, I’m trained as an experimentalist, and my interest is pretty focused — as many Ph.D. students are either forced to, or are trained to be so. But any questions related to how the mind works trigger my interest, and I wish to be of help by bringing in some neuroscientific and psychological ideas into Seung Chan’s thesis and the discussion.

david: My name is David Watson. I like to have “an attitude of gratitude” though I think it gets lost in a lot of what I do or say. Slim knows this from working with me for a couple years at maya design in Pittsburgh. I have a deep need to understand reality in its purest form, to seek the highest levels of production quality even when they don’t matter to anyone but me, and to achieve symmetry in literally everything.

They say that at the root of engineering is this “truth seeking” and you’ll see elements of that here from me. I apologize in advance for my forthrightness. I have a way of speaking that’ll make you think I think I’ve known you for 20 years.

I like the way Slim has defined the introduction, because while I work in software , I don’t like to define anyone singu- larly, certainly not myself, and I like to think of this more as “creative mediums of expression.” I’m a musician, a photo- grapher, a skier, a cyclist, a runner, a thinker, a reader, and a writer. And I’m glad we’re not all the same. Nice to meet you all. Cheers.

jeff: Hi, my name is Jeff Wong. Slim and I are intellectual buddies from Pittsburgh. He was a working man on the South Side of Pittsburgh at maya design, and I was a Ph.D. student in human-computer interaction (HCI) at Carnegie Mellon University (CMU).

I will be bringing my background in computer science and cognitive science. Slim says I can bring some perspective from theoretical computer science. Also, I know some of conceptual history of Artificial Intelligence (AI), psychology, cognitive science; some familiarity with psychiatry, phenomenology, and tidbits of religion and spirituality; and some dabbling experience in philosophical thinking. I don’t know how deep my knowledge is in these areas, but I think I can at least point to relevant ideas and prior explorations that have happened in these areas.

anson: Hi everyone. My name is Anson Ann. I really thank Slim for inviting me to this group. I feel so honored to be able to take part in this conversation. Reading the background stories, expertise, and interests of you folks really humbles me. It does start to feel a bit like a mini ted here!

Well, I first met Slim in CMU back in 1995 Although we were not in the same department — he was in computer science, and I was in electrical and computer engineering — our dorms were close to each other, and we had a common interest :  music and guitars. We used to take a cab together to a local musical instrument store and drool over those guitars and music gadgets. We first looked at guitars together, then he gradually moved onto djing, and I moved to synthesizers. Anyway, no matter what we do now, I think both of us will always have a musician inside us.

After CMU, I worked at bbn technologies — now Raytheon—in Boston as a speech software specialist/scientist. We customize speech software solutions for the u.s. government intelligence community, enabling them to do speech recognition, machine translation, and information extraction on Arabic, Chinese, Spanish, and English broadcast news all over the world. Much of my work involves language model training, pattern recognition, signal processing, and some human-computer interaction.

Then about six years ago, a big turning point happened in my life. I sensed this calling from God for me to become a pastor. Just like Slim who took the challenge switching from science to fine arts, I quit my software job and enrolled in a theological school. It was quite a big stretch for me, for studying the humanities requires a very different temperament. I realized that my mind, which was trained for engineering, preciseness, and comprehensiveness, wasn’t ready to deal with the ambiguity, complexity, tension, and paradoxes that you often find in history, literature, religion, and philosophy.

I have just finished my studies and now I’m an Anglican priest pastoring at the Anglican Network Church of the Good Shepherd in Vancouver, Canada. And as a pastor, what I hope to contribute to this conversation is my anthropological understanding.  ( i.e., What does it mean to be human.)

First, I am going to be upfront about my faith and convictions. I will speak from a Christian perspective and understanding of what is means to be human, for I believe anthropology stems from theology. A core doctrine in my faith tradition is that of the Holy Trinity: that God, who revealed himself to us in history, is known to be a three-in-one relationship, a unity-in-diversity, a dynamic-yet-unchanging entity, a harmonious dance in reciprocal love that overflows with creativity and creational power.

Since the entire universe is created and sustained by a relational being, the very core of our being and reality is supposed to be relational. And as we human beings are made in the image of this relational God, so we are also ontologically relational.

We are made to relate, to empathize, to love and be loved. There is something intrinsic about human beings that we want to understand and be understood. I believe the torture of imprisonment is not just lacking freedom, but more about losing the ability to relate to others and the outside world. Relational beings unable to relate are just like fish out of water.

Anyway, I know not all of you are religious or spiritual, so you may or may not share my perspectives, but I just hope I could, in some way help inspire Chan to continue exploring this topic about empathy. I’m still very much a geek at heart, so I also hope I can contribute to the other aspects of this conversation about computers, programming, and human-computer interaction.

I look forward to seeing Chan write more. Because empathy is about listening first, isn’t it? I hope we won’t flood his comments area with too many of our own ideas, but let him express what he wants to say first, then respond to him accordingly.

an-lon: Nice to meet you, I’m An-Lon Chen. As for me, I also went to the International School of Beijing (ISB) with Chan for a semester of high school in 1994 ,  I was a senior, he was a junior, and we both worked on the yearbook together. That would be the end of the story right there, except ISBers tend to be a close-knit bunch and it seems like for the past decade and a half we’ve always had each other’s contact information via some mailing list or another without ever actually interacting personally.

Let’s just say that my relevance to this project is that over the years I’ve gone from comparative literature to computer science to user interface design to computer graphics to character animation. I am now a full-time student at AnimationMentor. Prior to that I was at DreamWorks working on Shrek 4, and before that on Mummy 3 at Digital Domain.

Perhaps more than anyone else I know, I’ve had to approach computers and computer science as much from an anthropological perspective as well as a technical one —deciphering a subculture and a jargon in order to pass as a native.

I’m a geek at heart, with my fair share of the stereotypical social inadequacies . I’m pretty sure I was born socially tone deaf, and only as an adult began to figure out the nuances of interacting with others. That said, pretty much every big break in my unlikely computer science career has come from possessing some unusual degree of empathy . First, the amateur exercise in anthropology that drew me to geek culture; second, the turn towards user interface development, which brought me to LA and the film/vfx industry; third, the current foray into character animation, which is all about convincing audiences that dead pixels can walk, talk, laugh, and cry.

Point being, I care personally about Chan’s topic: computers and empathy. I have no earthly idea where this blog is going or how it’s going to become a thesis, but I’m following it because at least some aspects of it touch on things that I, too, have been wondering all my life.

But now, can we start from the top? Empathy? With computers?

me: Yes, with computers.

an-lon: The best developer is inevitably quite the computer whisperer, of course, but I would have never actually thought of that rapport as empathy.

me: What would you have thought of it as then?

an-lon: Two synonyms came to mind. One was grokking, the other was acculturation. Grokking, because, well, I’m a sci-fi geek and I like having a word to express deep understanding and truly “getting it.” Both my parents are scientists, and while they are both fairly technically-savvy — my dad has written Fortran and assembly language code and my mom uses Photoshop and Illustrator for graphics and charts in scientific journals — I’m not really sure either of them has ever grokked computers ;  their mindsets are a little too unyielding to ever completely get on the computer’s wavelength, so they often end up fighting the computer in unnecessary ways.

For example, if my mom gets a PowerPoint concept stuck in her head, she invariably has trouble figuring out the Photoshop equivalent because she’s speaking a different language without even knowing it. Both my parents are extremely good within limited contexts, but don’t have the particular empathy required to troubleshoot — learning a new domain comes slowly.

Wait…

Ha ha ha ha ha ha!

I just looked up “grok” on Wikipedia. It says, to grok is “to share the same reality or line of thinking with another physical or conceptual entity. Author Robert A. Heinlein coined the term in his best-selling 1961 book Stranger in a Strange Land. In Heinlein’s view, grokking is the intermingling of intelligence that necessarily affects both the observer and the observed.”

But, it gets even better.

It also says that the Oxford English dictionary defines grok as “to understand intuitively or by empathy; to establish rapport with” and “to empathize or communicate sympathetically (with); also, to experience enjoyment.”

Drum roll, loud banging of cymbals. (Smiles) I actually wasn’t as far away from your wavelength as I thought. I had turned to Wikipedia as a joke, but it did hit a nerve. What I took away from it is that it’s never a purely intellectual exercise to really truly understand something, be it an immediate piece of code or an underlying computer science concept.

me: Exactly! There is an inextricable link between empathy and the act of learning that is non-obvious to most people. And I think it’s non-obvious, because we’re used to separating the cognitive from the emotional, or the mind from the body. For example, I’ve heard many people say that empathizing is not the same as understanding. On the surface, there’s nothing significant about that statement. Of course they’re not the same. If they were, why would we have two separate words? But it becomes significant once you realize that what people mean is that understanding is inferior or shallower than empathizing. Well, that depends on how you define the two words. It is only so if you include inaccurate understandings as a legitimate form of understanding. I would argue that an accurate understanding of an other cannot be had without having tried to empathize with them.

anson: That reminds me of people telling me how I have an extra-ordinary amount of patience in front of a computer. I don’t know if it’s because I know what the computer is doing inside, but I can be patient even if it’s slow or stalling. And also, whenever my dad encounters a computer problem, he always asks, “How stupid is this computer! Why can’t it do this and that?” and I always feel like I’m defending the computer saying, “It just can’t… this is what it can and cannot do. Don’t be too hard on it. Be patient. It’s still crunching numbers. There’s nothing you can do except rebooting the machine. And here’s a way to work around its limitations .  Yada yada yada.”

Isn’t that also related to empathy?

me: Yes, I would definitely say so. I don’t think you can have patience for the computer, if you cannot empathize with it. We’re much more likely to lose patience for the computer, when we cannot empathize with it. Just think of a time when you got the hour glass or the beach ball for no apparent reason. That’s very difficult to empathize with. That’s like interacting with someone who is too pissed off to tell you what is going on.

I think the best example of people trying to empathize with the computer is when they’re debugging. When we are debugging a software program, we are trying to figure out why the program is behaving the way it is, and our head gets filled up with nothing but our understanding of the state and configurations of the program, not to mention the various hardware mechanisms like memory, processor, and external storage. What I’m doing is trying to think as if I were the computer.

an-lon: I couldn’t agree more about the debugging. Perhaps we use our empathetic faculties for debugging because our brain cells weren’t equipped to access that deeper cloud of intuition any other way. Our brains have been wired for millennia to interact with fellow humans and, as far as I’m concerned, it’s an extremely useful act of hijacking to tap that empathic cloud in order to outsmart a machine.

And just to be clear, I’m not talking about anthropomorphizing the machine, I’m talking about accessing our own preexisting, well-developed resource of empathic faculties to interact with it. Oddly, I anthropomorphize just about everything under the sun: teddy bears, disappearing keys, food that’s been in the fridge for too long. But I’ve never been tempted to anthropomorphize computers.

me: Didn’t you say there were two words that came to mind? What was the other one besides “grokking”?

an-lon: Oh, acculturation.

me: Why did that come to mind?

an-lon: Because computers and programming languages are created by humans. The magic that bridges the abstraction of 0’s and 1’s with human neurons is language. Windows and mice are metaphors—picture a window in a house, picture a mouse running around on its four little paws, now marvel at the metaphor that got us where we are today! Zipping, unzipping, bugs, these are all metaphors. Computer concepts are all abstract until we give them names and map them to something we can understand. Even the act of stepping through code using a debugger is a concession to a human need for a linear story line.

Learning how to program is similar to language acquisition, not because computer languages are anything like natural languages — allowing C++ to fulfill a language requirement like French or Spanish would make no sense — but because learning how to write code is very much a process of acculturation. Just as it’s pretty much impossible, or at the very least pointless to learn a natural language without a cultural context, it’s impossible to write code well without absorbing its many sub-cultures. Best practices, conventions, idioms, and design patterns are all cultural constructs within a human community, not semantic ones within the machine.

Put in that light, the idea of empathy with computers is staggeringly mundane — we’re talking about forming a rapport with the community of their very human creators, not a sentient and malevolent Hal. And yet, my rapport with, say, Linus Torvalds goes through multiple layers of translation, not the least of which is through the machine and back. And if I were to go out and write a Linux patch, I’d damn well better have empathy with the Linux operating system so I can design something appropriate  . . . and yet it doesn’t feel like real empathy. It’s not real the way a spoken word is real, a heartbeat is real, the touch of a hand is real. And yet, to anyone who’s ever gone into a programming trance and been absorbed to the point of forgetting to eat, sleep, or shower, it’s profoundly real, perhaps more real than reality. It’s an emotional state as much as a physical one.

david: Slim, how are you going to treat this subject in a secular fashion? It’s going to be very difficult, because so much of it leans toward feeling and emotion as opposed to logic, science, neurons, etc. It barks up the quality / quantity tree that is split down the center and very divisive.

me: Hmmm… I never thought of this as non-secular. Metaphysical, yes. Are you equating the two?

david: Well, just as Zen and the Art of Motorcycle Maintenance is not about Zen, I don’t think what you’re after is about empathy. It’s deeper than that. To empathize with the computer is to anthropomorphize. To anthropomorphize is to visit our expectations on reality. Computers aren’t humans and they never will be. Can man make a better human? Probably. Will that human have better distinguishing human characteristics? No. In the very same sense that James Howard Kunstler argued that architecture was moving toward a loss of a sense of place — which I agree with — robotics goes down the same boring path, most likely because it has no other choice. If it didn’t, we’d be defining an engine of individua- tion, and I’m pretty sure nobody is doing that. And that’s the miracle of humanness.

jeff: Speaking of humanness, historically speaking, artificial intelligence referred to abilities that we thought computers were incapable of. However, as solutions to problems began to appear, these abilities — like chess playing and language recognition —were no longer considered intelligence. How computer programs tackle intelligent tasks is always different from how humans actually do them; sometimes better or more thoroughly, but at other times, seemingly stupid.

me: What do you mean?

jeff: Why does ai trip up on “special cases”? Because the way we program intelligence is by making problems formal (i.e., accessible to the computer). When problems are formalized, they can be solved by rules. Where rules don’t quite work, we have rules for selecting rules or rules for creating the rules to select rules with ( i.e., machine learning). I think we approach problems this way because our way of accessing how we think, and communicating that to other people is in the framework of rationality. I think rationality is primarily a structure for thinking about thinking.

How we think isn’t quite rational. It’s more like rational++. When people appear rational, we can empathize with them. Irrational people, too, but not as easily. Part of anger is not knowing why. If you know how the machine works, you can be angry at the situation, but it’s not the machine’s fault, it’s whatever is broken or not working inside. Does anger require a thing to be angry at? If you’re angry at the thing and you don’t know how it works, it might as well have a mind of its own. It makes no difference to you. Consider the University of Texas clock tower shooter. You can imagine being angry at him for shooting someone you know, but then you find out he had a tumor and he requested an autopsy in a note he left at his house with his dead family. Somehow that kind of situation is a bit less angry because you know why.

Understanding the mechanism changes how we think about the thing. For example, I remember being excited about taking an ai class and learning the magic. But it turned out to be a whole bunch of hacks  —  or so it appeared. It’s no longer magic when you know how it works. Now, I don’t quite understand what you mean by empathizing with computers. What you’re doing when programming is simulating your program on your model of the programming language runtime. Yes, it’s sort of like empathy, but I thought empathy was being able to feel what you feel. We empathize with real people based on our concepts and experiences of other people. This is the theory of mind,3 which autistic people lack. For that, they are alone in the universe because other people simply don’t exist. So you need models of other people to empathize with them. Still, empathy is a feeling about feeling. I still don’t get empathizing with computers. My current idea of what you might be thinking seems wrong.

joonkoo: I second Jeff on this point. I don’t quite understand what it means to empathize with computers, either. I don’t necessarily think that you need to have answers to all these questions now. Some of them are certainly empirical questions, and worth investigating more. But, I would like to have a better grasp of your idea of empathizing with computers, and I still can’t quite get it. Perhaps it will get explained in your future writings?

me: Yes, it will. Although, I am starting to realize that I’ll be up against a lot of criticism, because some people may be equating the theory of mind with empathy.

Allow me to first write about my experience with physical materials, and I hope that will better explain why I think empathy is not exclusive to human relationships.

(Smiles) But most importantly—my God!—I can’t tell you all how much I love this tightly-knit discussion environment!

——

1 Some of my old friends call me Chan. It is the latter half of my full first name, Seung Chan. I had originally adopted the name to accommodate those who could not pronounce the first half of my name. But I have since abandoned this name because I feel that it robs me of my full identity. Those who cannot pronounce my name call me Slim—made from concatenating the first letter of my first name to my last name — which is a new identity I have constructed since my arrival in the U.S. How did the name come about? It was my e-mail username in college.

2 Hyung means older brother in the Korean language.

3 Theory of mind is the ability to attribute mental states—beliefs, intents, desires, pretending, knowledge—to oneself and others and to understand that others have beliefs, desires, and intentions that are different from one’s own. It is typically assumed that others have minds by analogy with one’s own, and based on the reciprocal nature of social interaction, as observed in joint attention, the functional use of language, and understanding of others’ emotions and actions. (Premack and Woodruff, 1978, 515–526) (Baron-Cohen, 1991, 232–251) (Bruner, 1981, 41–56)

Premack, D. G.; Woodruff, G. (1978). “Does the Chimpanzee Have a Theory of Mind?” Behavioral and Brain Sciences 1 (4): 515–526.

Baron-Cohen, S. (1991). “Precursors to a Theory of Mind: Understanding Attention in Others.” In A. Whiten (Ed.), Natural Theories of Mind: Evolution, Development and Simulation of Everyday Mindreading (pp. 233-251). Oxford: Basil Blackwell.

Bruner, J. S. (1981). “Intention in the Structure of Action and Interaction.” In L. P. Lipsitt & C. K. Rovee-Collier (Eds.), Advances in Infancy Research. Vol. 1 (pp. 41-56). Norwood, NJ: Ablex Publishing Corporation.

Gordon, R. M. (1996). “‘Radical’ Simulationism.” In P. Carruthers & P. K. Smith, Eds. Theories of Theories of Mind. Cambridge: Cambridge University Press. (59-74).