Researchers at the University of Buffalo (UB) are producing immersive virtual reality (VR) dramas in which the users are given some goals at the beginning and are interacting with 'self-aware' computational agents. The UB Reporter writes that they are putting a new face on 'user-friendly' VR environments. They already created a psychodrama called "The Trial The Trail" in which "the user is given two companions named Filopat and Patofil and told that at the end of her experience she will get her heart's desire." And because the software agents are continuously improving and 'improvising' around human users, the show is different every time. I don't know if this will lead to some mainstream application, but I'm sure that the researchers had lots of fun in their CAVEs-like systems.
Here is the introduction from the UB Reporter.
A virtual-reality drama by UB researchers -- aimed at transforming the movie-going experience -- is driving the development of increasingly "self-aware" computational agents that are able to improvise responses to the spontaneous actions of human users.
These improvisational computer agents are expected to influence the development of electronic devices of tomorrow, making them much more user-friendly because they will be able to respond to the idiosyncratic needs of each user.
Here are more explanations.
By necessity, said professor Stuart C. Shapiro, those characters are computational agents that must be capable of behaving in sophisticated and very human-like ways, attributes that also can help take "user-friendliness" for computers and other electronic devices to new heights.
"This is a step in the design and implementation of computer agents that are aware of themselves and their actions, as well as the environment they are in," he explained, "so this work is relevant to any application in which people interact with a device or system."
Here is a storyboard image of the stage of their "The Trial The Trail" project with Patofil, Filopat and the user as the green figure (Credit: University of Buffalo).
In so far as religion assumes the world to be directed by conscious agents who may be turned from their purpose by persuasion, it stands in fundamental antagonism to magic as well as to science, both of which take for granted that the course of nature is determined, not by the passions or caprice of personal beings, but by the operation of immutable laws acting mechanically. In magic, indeed, the assumption is only implicit, but in science it is explicit. It is true that magic often deals with spirits, which are personal agents of the kind assumed by religion; but whenever it does so in its proper form, it treats them in exactly in the same fashion as it treats inanimate agents, that is, it constrains or coerces instead of conciliating or propitiating them as religion would do. Thus it assumes that all personal beings, whether human or divine, are in the last resort subject to those impersonal forces which control all things, but which nevertheless can be turned to account by any one who knows how to manipulate them by the appropriate ceremonies and spells.
—Sir James George Frazer (1854–194l)
And here is Patofil alone (Credit: University of Buffalo).
You also can see a video clip of "The Trial The Trail" project (54.7 MB, so be cautious).
And here are some of the reasons why this project is pretty unusual.
While other computer scientists are exploring multiple agent systems, he continued, this project is more demanding because the agents in the drama must be able to "perceive" themselves and then respond to the user.
So, as the human user proceeds through the drama, his or her actions are being recorded computationally over the Internet, interpreted psychologically and used to prompt the responses by the virtual characters.
Because of this, the drama is different every time, a factor that the researchers say is both a more challenging and exciting type of entertainment, while also more computationally demanding.
For more technical information, you can read this technical paper published in 2004 under the title "Psycho-Drama in VR" (PDF format, 12 pages, 220 KB). The above illustrations were extracted from this paper.
Will this research effort lead to something useful? I've no idea, but I'm sure I would have like to be involved in this project if my hometown was Buffalo instead of Paris.
The woman who is rearing a family of children; the woman who labors in the schoolroom; the woman who, in her retired chamber, earns, with her needle, the mite, which contributes to the intellectual and moral elevation of her Country; even the humble domestic, whose example and influence may be moulding and forming young minds, while her faithful services sustain a prosperous domestic state;Meach and all may be animated by the consciousness, that they are agents in accomplishing the greatest work that ever was committed to human responsibility. It is the building of a glorious temple, whose base shall be coextensive with the bounds of the earth, whose summit shall pierce the skies, whose splendor shall beam on all lands; and those who hew the lowliest stone, as much as those who carve the highest capital, will be equally honored, when its top-stone shall be laid, with new rejoicings of the morning stars, and shoutings of the sons of God.
—Catherine E. Beecher (1800–1878)
Source: Ellen Goldbaum, The University of Buffalo Reporter, March 3, 2005, Volume 36, Number 24
Related stories can be found in the following categories.
AI
Displays
Movies
Virtual Reality
Vision and Visualization.