UCR

Computer Science and Engineering



Christian R. Shelton, Professor

Cobot in LambdaMOO: An Adaptive Social Statistics Agent (2006)

by Charles Lee Isbell, Jr., Michael Kearns, Satinder Singh, Christian R. Shelton, Peter Stone, and Dave Kormann


Abstract: We describe our development of Cobot, a novel software agent who lives in LambdaMOO, a popular virtual world frequented by hundreds of users. Cobot’s goal was to become an actual part of that community. Here, we present a detailed discussion of the functionality that made him one of the objects most frequently interacted with in LambdaMOO, human or artificial. Cobot’s fundamental power is that he has the ability to collect social statistics summarizing the quantity and quality of interpersonal interactions. Initially, Cobot acted as little more than a reporter of this information; however, as he collected more and more data, he was able to use these statistics as models that allowed him to modify his own behavior. In particular, cobot is able to use this data to ``self-program,'' learning the proper way to respond to the actions of individual users, by observing how others interact with one another. Further, Cobot uses reinforcement learning to proactively take action in this complex social environment, and adapts his behavior based on multiple sources of human reward. Cobot represents a unique experiment in building adaptive agents who must live in and navigate social spaces.

Download Information

Charles Lee Isbell, Jr., Michael Kearns, Satinder Singh, Christian R. Shelton, Peter Stone, and Dave Kormann (2006). "Cobot in LambdaMOO: An Adaptive Social Statistics Agent." Autonomous Agents and Multi-Agent Systems, 13(3), 327-354. pdf          

Bibtex citation

@article{Isbetal06,
   author = "Isbell, Jr., Charles Lee and Michael Kearns and Satinder Singh and Christian R. Shelton and Peter Stone and Dave Kormann",
   title = "Cobot in LambdaMOO: An Adaptive Social Statistics Agent",
   journal = "Autonomous Agents and Multi-Agent Systems",
   year = 2006,
   volume = 13,
   number = 3,
   pages = "327--354",
}

More Information

Address

University of California, Riverside
Chung Hall, room 327
Riverside, CA 92521
Tel: (951) 827-2554
E-mail: cshelton@cs.ucr.edu

 


Other Links