The TAMER codebase is available at, along with related goodies like a Java Applet interface for running experiments through people’s browsers (if they’re willing to jump through some hoops added since I coded all of this) and some implementations of basic RL and learning from demonstration algorithms. The current version has an MIT License (though that’s very poorly documented).

Specifically, follow these instructions to get the project working.

    1. In Eclipse (or another git-compatible IDE), create a project and checkout the repository at
    2. Add all jar files in tamer-share/lib/ to that project’s build path.
    3. Run examples in the edu.utexas.cs.tamerProject.demos package.
    4. Ask me questions and tell me what specific documentation you’d like me to add.