CHAT 2010: The Art of Gaming

A giant banner of Fruit Fucker greets you as you enter the gallery, setting the tone. This is fun stuff. There are many pieces that fall into the illustration category, including several examples of game concept art and a large mixed media sculpture entitled Snot Rocket. A pair of paintings by Andy Foltz celebrate the LMAOness of online gaming chat.

There are a few contemplative pieces, too. 30 Years of Disappointment by Plastic Flame Press has a “seven ages of man” feel to it: a comic-strip lithograph features a young man maturing alongside his video game systems, before finally returning to Pong in middle age. (Jesper Juul, in his talk this afternoon, mentioned a “standard video game model” by which games were sold on the basis of increased complexity and improved graphics, from around 1980 until the explosion of casual games circa 2005).

The art:

1. Penny Landing by Penny Arcade


2. Environmental Concepts by Adam Capps for Spark Plug Games


3. The Gorgon by Adam Capps


4. Love the One You’re With by Jessica Fielhauer


5. Snot Rocket by Lee Williamson


6. The Eyes Have It by Lee Williamson


7. Donkey Kong NYC by Paul Frederick


8. Game Dogs by Jessica Fielhauer and George Palmer for The Escapist


9. Bare Druids by Andy Foltz


10. Caterday Nite is All Rite for Fite by Andy Foltz


11. Make it Rain by Sean Kernick


12. Concept Images from Ratchet and Clank Future: A Crack in Time by Insomniac


13. Choose Your Avatar by Marc Russo


14. Points by Adam Capps


15. 30 Years of Disappointment by Plastic Flame Press

CHAT 2010: Transforming Narratives

I’ll refer you, first, to a great piece of commentary that has emerged from this talk: Whitney Trettien’s Digital Storytelling, Zola, Experimentalism, and the Scientific Method. Trettien knows literature, and places Michael Young’s work and Katherine Hayles’ thoughts in a historical and theoretical context.

The only thought that I might add is somewhat techno-utopian. Our lives are not intrinsically meaningful or teleological; we don’t have purposes, per se, except insofar as we create our own—a state of affairs that may be satisfactory to the existentialists among us, but one which many people will never successfully come to terms with. One of the many ways in which literature has functioned has been to create the relief of structured narrative: an immersive world where purposeful events take place. Sometimes, we create such narratives by selective remembrance of actual events, creating histories and myths.

Young’s games are designed to anticipate possible user actions and find ways to incorporate these actions while still moving the story to its predetermined narrative conclusion. As people spend more of their lives online, intersubjectively transforming virtual worlds into real ones, I can imagine a future where such systems, augmented with tremendous computing power, will allow people to carry out much of their lives within teleological narrative structures—meaningful existence, delivered by technology.

The accompanying dystopian thought: who will be the meaning-makers for these anti-existentialists, and how can we be sure that these narrative storytellers will have everyone’s best interests at heart?

CHAT 2010: The Bathysphere

Perhaps I would not have been as underwhelmed by the Bathysphere if I had not seen Robert Bach’s demonstration of Project Natal yesterday. The two projects invite comparison: each attempts to translate real-world motion into virtual motion. While Natal uses the body itself, the Bathysphere tracks the motion of three objects—a geodesic “beach ball,” a fishing rod, and a multicolored umbrella—and translates the user’s interactions with these objects into the movements of computer-generated sea life projected onto the walls of the exhibit.

The octopus, ray, and school of fish mimic the movements of their respective controlling objects, but do not allow the user to interact any more deeply with the virtual environment. Effectively, they are cursors, with the ball, rod, and umbrella functioning as novelty trackballs. Building this system must have been a tremendous technical challenge; hopefully, more will be done with it with time.

Edit: HASTACer Adam Rogers has a more positive take, including a video of the Bathysphere here.

CHAT 2010: User Driven: Does Size Matter?

Panelist Paul Jones took control of the discussion early, and didn’t let go. Seizing on moderator Paolo Mangiafico’s contrast between “lean back” (large screen: broadcast consumption) and “lean forward” (small screen: conversation participation) modes of media interaction, Jones pointed out the awkward middle space that the panel discussion itself occupied: a simulation of a small conversation being shown to a large audience. Jones stepped down from the stage in order to address the audience more directly.

Two of the panelists, Russ Pitts and Ross White, followed him down. Panelist William Shaw and Mangiafico stayed behind on stage, creating a visual contrast that corresponded roughly to the positions that the panelists took on new media. Jones, Pitts, and White all seemed open to the value of audience participation and social media; Shaw emphasized that the William Blake Archives, the project on which he works, is a “large screen” project designed to provide high-resolution tools to the lone scholar, whether professional or amateur.

Here are a few of the many points Jones made in his near-total domination of the talk:

The paradox of the mobile internet is that it doesn’t matter where you are, but it matters more where you are. The Internet closes distance and levels geographical distinctions, but because you’re accessing the Internet on a mobile device, the people you’re communicating with can’t assume that your physical body is tethered to your office or home. People on the mobile Internet spend a lot of time talking about where they are and what’s going on around them.

Print has a reputation for stability when compared to online media, but in fact print is highly unstable—multiple revisions, versions, and translations of most texts exist. [As I’m interested in text as a visual medium, I would add printings, layouts, type settings, etc.]

There are three populations happy with Kindle: 1. people who need large print books; 2. people who travel a lot; 3. people who do a lot of book editing and reviewing (so they don’t have to carry a bunch of books and manuscripts around). These are not necessary the audiences that Amazon imagined. We don’t know what people will do with the iPad until they’ve had a chance to do it.

Small-screen talk is more important than large-screen talk. People listen to their friends rather than to authorities; studies have shown that intimate settings and peer status create trustworthiness. By being aware of these tendencies, we will be able to make the truth stick in a world with too much information and no recognized experts.

Editor's note: I was unable to find an online presence to link to for William Shaw.

CHAT 2010: The Future of Entertainment

Robert Bach, Microsoft President of Entertainment and Devices, started his talk with a bounding run up the steps to the stage (must be a Microsoft thing). We found out that his favorite movie is the Shawshank Redemption. He likes Star Wars, too, but didn’t seem to want to talk about Avatar. He came bearing commercials for Microsoft, which he described as “not commercials for Microsoft.”

That’s okay. One of his commercials, for a new Xbox add-on called Project Natal, was jaw-dropping. Microsoft’s crimes against the creativity of humanity are legion. They include plague after plague of poorly designed fonts, the quashing of non-Microsoft technological innovation, and software interface styling that feels like the electronic equivalent of a blue ballpoint Bic writing on a manila envelope, forever. But in the last few years, Microsoft has been turning out some truly forward-thinking products. The Surface table was one such head-turning moment; Project Natal is sure to be the next.

Natal, the result of what Bach calls “deep research” in interface design, combines a camera and microphone with motion capture, facial recognition, and voice recognition technology. The device tracks points on the player’s body and translates this into on-screen motion. Stand in front of your television and kick; your on-screen avatar will kick. Motion through the virtual space of a video game—historically, heavily mediated through the pushing of arbitrarily meaningful buttons—is about to become much more like moving through real space. You will move your arm to move your arm.

Natal also recognizes voice commands, and it can identify individual players from session to session, using facial recognition software. Lots of smart guys with PhDs and James Dysonesque British accents worked on it.

I can’t help but see this as an answer to the Wii. Natal turns it up a notch on Nintendo, finally delivering a completely unencumbered, gesture-based gaming interface. Bach hinted that this technology may be under development for PC and mobile platforms as well. While it’s harder to imagine using something like this with a phone, putting Natal on the PC could open up a whole new world of software interaction.

Bach was bullish on the future of the entertainment industry, and sees a future populated with hybrid multimedia objects: books, movies, music, and games combined into one. This will come about through changes on three fronts: consumers, who increasingly have multiple screens and expect content to be available everywhere; creators, who will conceive of and develop new kinds of content; and the “canvas” itself, as new technologies afford new opportunities for creation.

Notably, he predicted that the artistic creative process will adopt characteristics of the software development cycle as a new generation of digital artists emerge. Would-be creatives were advised to learn as much math and science as possible to take advantage of the opportunities this new entertainment landscape provides.

CHAT 2010: Entrepreneurship & Collaboration

Two of the major themes of this year’s CHAT—gaming and electronic music—were presented as business interests. The talk’s raison d’être seemed to be demonstrating, for the sake of those who might find these subjects insufficiently serious, the existence of corporations that can and do make money in these spaces. The subject matter was to be the role of collaborations in entrepreneurship, but that topic gave way to general entrepreneurial advice as the ninety minutes went on. All of the companies were founded on innovative premises, and the panelists were intelligent and well-spoken:

Steven Aldrich (the geek: plaid shirt, Carolina blue jacket), President/CEO of Posit Science. Posit creates software to encourage brain fitness. Brain performance begins to decline after the 20s and drops sharply after the 60s. Aldrich’s company uses established science to develop games to help people improve their memory, focus, and mental agility. He emphasized the importance of using customer narratives, not just facts, to promote your brand.

Kip Frey (the suit: tasteful purple shirt, navy jacket), President/CEO of Zenph Sound Innovations. Of the three, Zenph is the easiest company to Google, but the hardest to describe. Their software can analyze a musical piece recorded in any time period and translate it—including, supposedly, every nuance of performance—into a data profile. That profile can then be used to exactly reproduce the performance, or it can become a starting point for re-interpreting the piece by manipulating performance style, instrumentation, or any of a number of other variables.

Eric Peterson (the hipster: green/gray argyle sweater, soul patch), President/CEO Vicious Cycle Software. Vicious Cycle is a major video game publishing house, one of many headquartered in the Triangle. They create console games for adults and for children, under their imprint Monkeybar Games. Peterson emphasized the importance of networking and forming well-rounded teams to succeeding in the games industry.

The subject matter of the talks fell back too frequently onto business advice platitudes: the importance of managing risk, having a well-researched business plan to attract capital, allowing time and fostering internal competitiveness to encourage innovation, being passionate about what your company does. But I can see the talk being helpful to a person from an arts, humanities, or technology background who is interested in capitalizing on their ideas.

CHAT 2010: Electro-Acoustic Sound Exhibition

My ability to enjoy this piece was diminished by what must be a frequent hazard of public ambient music consumption: a couple conversing loudly in the exhibition space. But I was able to listen for several minutes to “Dance of Fire,” a composition by Erdem Helvacioglu made up entirely of samples of fire whooshing, crackling, and sparking.

My knowledge of electro-acoustic music is limited, so I’ll just observe that the piece reminded me of listening to Curtis Roads’ Point-Line-Cloud, an album created by entirely synthetic means. Despite the electronic origins of the pieces, the effect of listening to either feels deeply primitive, even organic—inducing a feeling of excitement verging on foreboding.

Blogging from C.H.A.T. 2010

This week I’ll be attending the C.H.A.T. Festival (Collaborations: Humanities, Arts & Technology) at UNC-Chapel Hill and blogging on what I see. Serious gaming will figure prominently in the festival this year. A few of the events I plan to attend, with descriptions from the C.H.A.T. site:

User Driven: Does Size Matter? Audience expectations are driving trends in technology, and size is one area feeling the impact: What is the ideal screen size for a device, for content, for literature, and more? Wednesday, 11 a.m.

Scientific Method and Narrative Form. What happens when you combine an electronic literature expert with a computer scientist who uses algorithms to generate narrative? This conversation will explore the intersections and the opportunities. Wednesday, 1:00 p.m.

Serious Teaching and Learning in Serious Games. Gaming has taken a serious turn in many classrooms as educators discover the effectiveness of games as teaching tools. In this discussion, experts in K-12, higher education and industry discuss how pedagogy is embedded in serious games. Thursday, 2:00 p.m.

Changing Forms of Publication. New technologies have made possible mass publication on a scale never before encountered in our culture, breeding new possibilities for—and questions about—authorship and form. This panel examines how technology has transformed the practices of publication. Friday, 11:00 a.m.

Game as Medium. Game engines, the software systems designed for the creation and development of video games, have made their way into a variety of uses and fields. This panel will discuss some alternative uses of game engines, as panelists present their current game engine research in art, art history and mobile computing. Keynote speaker Jesper Juul will join the discussion, offering his theoretical perspective. Friday, 4:30 p.m.