Revision as of 08:04, 10 April 2009

Computational Sociology and Agent Based Modeling

Overview

This unit showcases Agent Based Modeling techniques and allows students to investigate them in a computational sociology context.

Background Reading for Teachers and TAs

Computational Sociology (wikipedia) Basic overview of computational sociology.
Tutorial on Agent Based Modeling ACM Digital Library An in depth look at ABM theory and technologies.

Reading Assignments for Students

The Structural Dynamics of Corruption: Artificial Society Approach It's a bit longwinded and technical, but I think 13 pages is reasonable. It's a "welcome to college" kind of text. I don't expect that they'll get any of the mathy stuff, though, so I think maybe just clipping out the parts about choosing rulesets and giving them that would be useful.
Artificial Societies, Virtual Worlds and the Shared Problems and Possibilities of Emergence This is relevant because of its discussion of emergence. I think for students it will help to justify why they're learning agent based modeling (because the emergent behavior of the models mimics the emergent behavior of these virtual worlds)
A Proximate Mechanism for Communities of Agents to Commemorate Long Dead Ancestors Though possibly more computational anthropology, I think this is a softer intro than the corruption model, and arguably more interesting.
Can Extremism Guarantee Pluralism? Another very long one, but such a fascinating topic I think it would engage students (especially Earlhamites).
Computational Sociology and Agent Based Modeling Too long to read in full, but the introductory prose is extremely illuminating.

Reference Material

Tutorial on Agent Based Modeling ACM Digital Library An in depth look at ABM theory and technologies.

Lecture Notes

These are very high-level... narrowing them down more will help a great deal. Also, how is the split made between the two+ classes?

I'd argue that they need to be expanded, that at a high level they cover the correct topics but need more depth to be useful.

What is Agent Based Modeling?
- Game of Life
- Emergent Behavior
- What are its advantages and disadvantages? for instance, what ARE the advantages/disadvantages?
Where is it useful? How is it useful in these disciplines? etc~
- Economics
- Sociology
- Biology
- Information Science
Some Examples
- Boids
Computational Sociology
- Who?
  - Axtell and Epstein - Growing Artificial Societies
- Why?
  - Perhaps distribute and discuss introductory materials from "Computational Sociology and Agent Based Modeling" article
- Example models, demo in class
  - Self Assembling of Information on networks
  - Sugarscape

Lab

Excercise in coming up with agent sets and agent relations. Have students think about a possible model of Saga sitting patterns over time. Their assignment is to come up with a set of agents and a set of agent relations and a short description of how such a model's results would evolve over time.

Process

What to do, step-by-step
- Discuss with your lab mates a potential "Saga Sitting pattern" model with attention to the factors involved and potential ways of collecting data. Write down these notes.
- Brainstorm a set of agents that could be used in such a model. Write up a description of each model and explain why you thought it would be useful. A minimum number would be helpful here. People are lazy.
- Brainstorm a set of relations between agents that could be used in such a model. Examples include students' like or dislike of certain food agents, students' like and dislike of each other, students' attendance at simulatneous events. Write up a description of each relation and explain why you thought it would be useful.
What to look for
- Is it hard or easy to account for many of the involved factors? + why? (yes/no-type questions are really easy for students to totally blank out)
- How does this process differ from other types of modeling?
  - Do you think coming up with mathematical formulas to describe the same issues would be easier or harder? + why?
  - What challenges arise when you try to come up with agents? with agent relations?
What to record
- Your notes and agent / agent relation descriptions
- Your answers to the 'what to look for' questions.
- A short description of how such a Saga model, using your agents and agent relations would evolve over time. Looks like this clarifies the above comment's question

Write-up

Required elements
- Notes and descriptions
- Answers
- Model outcome + saga map.
Visualization opportunities
- Draw out a map of saga to aid in your final description
Optional elements
- None
Provide a template for the first couple of labs ala CS128?
- Not sure? I didn't take CS128.

Software

Nothing; maybe java for example applets. Where were the example applets??

Bill of Materials

Nada. Paper and pencil.

This lab seems kind of short as compared with the other ones, which isn't necessarily a bad thing. However, if you wanted to move it to a prelab in order to have more time to do some sort of example or have them do something with Looking Around Corners as part of the lab, that might be good. On the other hand, you could also have them do some real life homework, like looking at the distribution of how people sit in Saga. Maybe they could find some environmental factors that influence students in Saga as well (ie people tend to sit closer to food?).
Agreed, I'm not sure this would fill up an entire 3 hours or however long labs are. Re: real life homework/observations: are people just people, or would we want them to account for gender, race, year, age, etc?

Evaluation

CRS Questions

1. What is Emergent Behavior?
- A. The complex outcome of the interaction of many simple rulesets
- B. How we verify and validate Agent Based models
- C. How we define rulesets for agents in an agent based model
- D. How we determine the formulas we use in mathematical modeling
2. Who wrote the seminal text on sociological agent-based modeling?
- A. Peck & Rogers, et. al
- B. Axtell and Epstein
- C. Axeman and Edlefsen
- D. Whitehall and North
3. What is the name of the first agent-based biological model?
- A. Droids
- B. BirdBots
- C. Boids
- D. BDroids

Quiz Questions

Explain how agent based modeling's concept of emergent behavior could be used to explain some natural phenomenon. Name three good examples of things that could be used as agents. Name three good examples of agent relations that could be used in a model. Explain why it is sensible to model bird flocking using ABM. Extend this to justify modeling society with ABM.

Agent Based Modeling and Computational Sociology Metadata

This unit introduces students to Agent Based Modeling through the use of examples and then has them work in a context of Computational Sociology to learn more This section contains information about the goals of the unit and the approaches taken to meet them.

This section contains information about the goals of the unit and the approaches taken to meet them.

Scheduling

Should certainly come after mathematical modeling and before systems dynamics.

Concepts and Techniques

Pedagogical
- Inquiry Based Learning
- Degrees of open endedness
- uses science to illustrate complexity of world around us
Structural
- CRS
- largely platform independent

General Education Alignment

Analytical Reasoning Requirement
- Abstract Reasoning - From the [Catalog Description] Courses qualifying for credit in Abstract Reasoning typically share these characteristics:
  - They focus substantially on properties of classes of abstract models and operations that apply to them.
    - Complete. Agents -> abstract models
  - They provide experience in generalizing from specific instances to appropriate classes of abstract models.
    - Complete. discussion of boids, sugarscape and agent based modeling as a whole
  - They provide experience in solving concrete problems by a process of abstraction and manipulation at the abstract level. Typically this experience is provided by word problems which require students to formalize real-world problems in abstract terms, to solve them with techniques that apply at that abstract level, and to convert the solutions back into concrete results.
    - Complete. the emergent behavior is a process of abstract manipulation; comparing emergent behavior back against the real world is "converting solutions back into concrete results"
- Quantitative Reasoning - From the [Catalog Description] General Education courses in Quantitative Reasoning foster students' abilities to generate, interpret and evaluate quantitative information. In particular, Quantitative Reasoning courses help students develop abilities in such areas as:
  - Using and interpreting formulas, graphs and tables.
    - Partial. Little of this - the point is to avoid formulas (initially), but graphs and tables come up when analyzing model results.
  - Representing mathematical ideas symbolically, graphically, numerically and verbally.
    - Partial. Little of this. We're working with people, not numbers.
  - Using mathematical and statistical ideas to solve problems in a variety of contexts.
    - None.
  - Using simple models such as linear dependence, exponential growth or decay, or normal distribution.
    - None. This could be worked in, but isn't there now.
  - Understanding basic statistical ideas such as averages, variability and probability.
    - None.
  - Making estimates and checking the reasonableness of answers.
    - Partial. In a more abstract way than most mathiness.
  - Recognizing the limitations of mathematical and statistical methods.
    - Complete. This is fulfilled - the point of ABM is the limitation of mathematical and statistical methods.
Scientific Inquiry Requirement - From the [Catalog Description] Scientific inquiry:
- Develops students' understanding of the natural world.
  - Complete. Yes. Agent based methodology informs a way of thinking about natural processes that differs from more typical techniques - the ideas of emergent behavior are present in every day life.
- Strengthens students' knowledge of the scientific way of knowing — the use of systematic observation and experimentation to develop theories and test hypotheses.
  - None.
- Emphasizes and provides first-hand experience with both theoretical analysis and the collection of empirical data.
  - Complete. Models = theoretical. Analyzing one's own social circle, for example, is empirical collection.

Scaffolded Learning

None. The unit is lecture and work; neither fall into a set scaffolded structure.

I think you could re-consider this for the lab. Start simple, provide a bit of structure, and let them extend into and through that as far as they can.

Inquiry Based Learning

The get to think creatively; they make a (static) model and get to think up their own agent based model (in an easy, but still interactive, way)

Agent Based Modeling and Computational Sociology Mechanics

To Do

Read and consider JoshM's message about alife.
Expand lectures notes.
Come up with second lab, do design.
Consider the exercise-like things that Raush uses at the start of his article Seeing Around Corners

Comments

Make answers bold please!
Some of this is reference/extra reading, then? If this is only a 1 week unit, will they just get a big pile of reading up front? -There are snippets of each reading that I think should be assigned.
When you say evolve over time, do you mean how the model would look when it was run, or how the people making the model would change it as they learned more information? Added a few words to clarify.

Lab Feedback

My only real issue with this lab is that isn't exactly so much a lab as a very interesting thought experiment. There should be some component of this lab that has them doing something and producing answers to questions with data and interpretation of that data at some point. The lab as it stands could definitely make a very good first chunk of a lab without too much change. The biggest change to make to what's already there would be to give more concrete deliverables. I found myself spending upwards of 3 hours on just this thought experiment because I had no idea what was an appropriate amount to write on each step. To make this lab complete past just that first part, there should be a second part that pushes them out of theory and into practice in one way or another.

Josh Letter

Hey Nate and Charlie,

Sorry for the delay in my response; this is a contentious topic and it's the last week of class over here.

Personally, I've been conflicted about the use of computational sociology for a while. It mirrors a larger debate in social science disciplines and their different perspectives on solving the same problem: predicting and understanding human behavior. Suscintly, sociology and anthropology study the productions of human interaction on the large scale (such as entire populations, economic systems, and nations) while psychology studies smaller scopes indepth (things like emotions of individual humans, dreams, etc). When the two ends meet in the middle by sociologists working down and phsycologists work up, we should have a pretty good understanding on how humans interact.

One side known as aLife, the side you've delved into, uses simple, local rules over many agents in simple virtual environments to observe emergent behavior. While this approach works well for modeling the behavior of some systems (like Boids, termites, and other things that use steering behavior -- check out open steer by Reynolds, the Boids guy), its usefulness depends directly on the efficacy of the rules used. At best the rules represent aggregate behaviors which are determined by valid and verifiable quantitative or qualitative experimental analysis. At worst, which is unfortunately true of many popular systems (including Boids), the rules represent whatever was floating around in the researcher's head at the time (though this can be seen as being a valid production of a social entity and may have its own validity).

If you have a simulation that has many agents that adhere to accurrate and simple rules that apply to a virtual environment that has a relatively small state space (like Sugarscape), all social interaction outside of the simulation is not possible and would have no impact on your results. There is no room for the "irrational" behavior seem when social scientists study people in the real world. In this case, irrationality is behavior that seems to be not in the observed entity's best interests given the variables observable by the social scientist. This does not mean the agents are inheritly irrational; they just base their decisions on rules different that those placed on the situation by the social scientist's perspective (think latent variables to put it into something more palatable for hard sciences). This lack of coverage of the effect of latent variables in individual agents in macro computational sociology is the main criticism levied against the field.

The other side of the larger social science debate, there is research being conducted that attempts to model the complexity of individual agents. This research ranges from modeling how the brain works mechanically, such as the ACT-R 5.0 architecture, to true-to-psych emotion and cognitive models (PyschSim and EMA by Stacy Marsella). The major criticism of this work is pretty straightforward: can we even understand the true complexity of how we think, let alone simulate it? Just another NP problem, right?

There is work that is trying to meet in the middle. Later additions to PsychSim and EMA, Thespian (Mei Si), the SGD (Synthetic Group Dynamics) Model of multiagent social interaction (Ana Paiva, check out FearNot!), and much more synthetic characters research are all in the space between macro computational sociology and complex, low agent count simulations. The problem a lot of qualatitive-phobic types have is that they don't produce neat numbers like hard scientific (Folding@Home) and aLife simulations. However, they do have some qualatative metrics, but the field of virtual human is still quite young (unlike aLife techniques and cellular automata) is still figuring out how to best evaluate itself. Good examples are in space of Embodied Conversational Agents (ECAs) used by Justine Cassell to treat autism and of the work in expressive intelligence field, such as the game Façade by Michael Mateas (playing Façade might be a good homework assignment for the class).

To wrap up, simulating social science touches many active fields of research and I'm a bit biased as I reside in one of those fields (expressive intelligence). If you want more information or something stated more clearly, feel free to email or call me on my cell -- I'd be happy to help out EC's CS department in any way I can. The class sounds like it will be fun!

Here are some links to back up my references: http://opensteer.sourceforge.net/ Justine Cassel: http://www.soc.northwestern.edu/justine/ Stacy Marsella: http://www.isi.edu/~marsella/root/root.html Ana Paiva: http://gaips.inesc-id.pt/gaips/people/anapaiva.html http://www.cyc.com/ http://www.opencyc.org/ ACT-R reference: Anderson, J. et al. 2004. An integrated theory of mind. Psychological Review, 111(4):1036–1060.

Cheers! Josh

Authorship

Nate Smith

@@ Line 179: / Line 179: @@
 * <font color="darkmagenta">Make answers bold please!</font>
 * <font color="darkmagenta">Some of this is reference/extra reading, then? If this is only a 1 week unit, will they just get a big pile of reading up front?</font> -There are snippets of each reading that I think should be assigned.
+* <font color="blue">When you say evolve over time, do you mean how the model would look when it was run, or how the people making the model would change it as they learned more information?</font> Added a few words to clarify.
 == Lab Feedback ==

Difference between revisions of "CS382:Unit-compsoc"