CS 591, Section EA Advanced Reasoning in AI Autumn 2004 Tentative Course Syllabus

Session	Date	Topic	Readings	Sample Application Reading	Assignment
1	Aug 26	Coordination Meeting

Papers for Presentations

Number	Topic	Paper/s	Sample Application Reading	Presenter
1	SAT via stochastic local search	[Selman etal '94]	Planning via SAT: [Kautz etal '96], [Kautz & Selman '96]	Geoffrey Levine
2	Binary Decision Diagrams	[Groote & Tveretina '03] [Groote & Zantema '00]	TBA TBA	Afsaneh Shirazi
3	Consequence finding	TBA, [del Val '99]	TBA TBA
4	Prime implicates/implicants	[Slagle etal '70], [de Kleer '92]	TBA TBA
5	Constraint satisfaction problems	[Dechter & Pearl '88]	TBA TBA	Kenton McHenry
6	Equational reasoning in FOL	[Genesereth & Nilsson '87] [Simon & del Val '00]	Commonsense reasoning TBA
7	DPLL in FOL	[Baumgartner '00], [Baumgartner '00b] (slides)	TBA TBA
8	FOL: decidable fragments	TBA,	Formal verification TBA	Deepak Ramachandran
9	Treewidth-finding algorithms	[Amir '01]	TBA TBA
10	Probabilistic inference with continuous variables	[Jordan '03], ch.13, [Lerner & Parr '01]	TBA TBA	Michael Simon
11	Metropolis-Hastings: Theory and examples	TBA	TBA TBA
11	Dynamic Probabilistic Relational Models	[Sanghai, Domingo, & Weld '03]	TBA TBA	Anna Yershova
12	Variational approximations for probabilistic inference	[Jaakola '00] [El-Hay & Friedman '01] [Jordan '03], ch.??	Biology: [Xing etal '03] information retrieval: [Blai etal '02]	Vince Horrell
13	Loopy belief propagation	[Yedidia etal. '03]	Turbo Coding [McEliece, MacKay & Cheng '98]	Jakob Metzler
14	Resolution in first-order probabilistic models	[Poole '03]	TBA TBA	Rodrigo Braz
15	SAT via probabilistic reasoning	[Braunstein etal '03]	TBA TBA	Hannaneh Hajishirzi
16	Dynamic Bayes networks and particle filtering	[Doucet etal '00], [Doucet etal '00b]	Sensor Networks: [Coates '04] Mobile Robots: [Fox etal '01]	Hanning Zhou
17	Kalman filtering	[Jordan '03], ch.15	SLAM SLAM2.0	Joseph Tucek
18	Factored inference with DBNs	[Boyen & Koller '98]	SLAM: [Paskin '03]	Shiau Hong Lim
19	Resolution strategies	[Genesereth & Nilsson '87]	TBD TBD	Bill Davis
20	Probabilistic equational reasoning	[Pasula etal. '02], [McCallum etal. '03]	Co-reference resolution TBD	Arthur Kantor
21	Dynamic backtracking for SAT	[Ginsberg and McAllester '94], [Moskewicz etal '01],	TBD TBD	Phil Oertel
22	Clauses/Variables ratio in SAT	[Selman, Mitchell, and Levesque '97]	TBD TBD	Xiaoxin Yin
23	Dynamic ordering strategies for SAT (*NOTE: SAME AS 21)	[Ginsberg and McAllester '94], [Moskewicz etal '01],	TBD TBD	(taken)
24	Decayed MCMC	[Marthi etal. '02]	Tracking [Khan etal. '03]

Number	Topic	Presenter
1	extension of lock resolution using craig's interpolation theorem
2	hybrid reasoning of logic and probabilities via partitioning (requires knowledge of FOPL, at least Halpern's work)
3	logical filtering with a first-order language
4	logical filtering with BDDs
5	activity detection using filtering (any method)
6	SLAM2.0 improved and applied to a mobile robot
7	Combining logical filtering and stochastic filtering
8	Survey propagation for dynamic settings (e.g., planning via SAT)
9	Approximation algorithm for hyper-treewidth
10	Implementation of an algorithm for planar treewidth
11	Filtering in an adventure/strategy game
12	Labeling image segments with words (using a probabilistic graphical model)
13	Implementation of Message-Passing as a restriction strategy for reasoning in FOL
14	Complete ``holes'' in Poole's paper on resolution in first-order probabilistic models
15	Equational reasoning in first-order probabilistic models
16	First-Order DPLL with equality
17	LSA-like robot control architecture with probabilities
18	Learning action models via filtering
19	MCMC for image segmentation
20	Robot localization for a basketball game
21	LSA-based control system for a robotic arm

-->

Projects

Number	Topic	Presenter
1	Logical filtering with a first-order language	Afsaneh Shirazi
2	Combining logical filtering and stochastic filtering	Joseph Tucek
3	A system for the control of a robotic arm	Anna Yershova
4	Image segmentation using MCMC: Implementation	Vince Horrell
5	Boyen-Koller for car tracking	Shiau Hong Lim
6	Comparing CSP algorithms	Kenton McHenry
3	Survey propagation for dynamic settings (e.g., planning via SAT)
11	Filtering in an adventure/strategy game
12	Labeling image segments with words (using a probabilistic graphical model)
13	Implementation of Message-Passing as a restriction strategy for reasoning in FOL
14	Complete ``holes'' in Poole's paper on resolution in first-order probabilistic models
15	Equational reasoning in first-order probabilistic models
16	First-Order DPLL with equality
17	LSA-like robot control architecture with probabilities
18	Learning action models via filtering
19	MCMC for image segmentation
20	Robot localization for a basketball game

Bibliography

Key	Authors	Title
[McCarthy '58]	John McCarthy	Programs with Common Sense
[Amir & Maynard-Reid '99]	Eyal Amir and Pedrito Maynard-Reid II	Logic-Based Subsumption Architecture
[Russell & Norvig '03]	Stuart Russell and Peter Norvig	Artificial Intelligence, a Modern Approach
[Genesereth & Nilsson '87]	Michael R. Genesereth and Nils J. Nilsson	Logical Foundations for Artificial Intelligence
[McFarland '93]	Michael C. McFarland	Formal verification of sequential hardware: a tutorial
[Biere etal. '99]	A. Biere, A. Cimatti, E.M. Clarke, M. Fujita, Y. Zhu	Symbolic model checking using SAT procedures instead of BDDs
[Barrett '03]	Clark Barrett	Logic in Computer Science, NYU, Fall 2003
[OpenGalen '03]	OpenGALEN, by Kermanog	GALEN common reference model, version 1.02, and software
[Baader & Nutt '03]	Franz Baader & Werner Nutt	Basic Description Logics, Ch.2 in the Description Logic Handbook
[Franconi '03]	Enrico Franconi	Natural Language Processing, Ch.15 in the Description Logic Handbook
[Gadsil, Koller, & Striegnitz '01]	M. Gabsdil, A. Koller, and K. Striegnitz	Building a Text Adventure on Description Logic
[Horrocks '02]	Ian Horrocks	DAML+OIL: a Description Logic for the Semantic Web
[Amir & McIlraith '03]	Eyal Amir and Sheila McIlraith	Partition-Based Reasoning for First-Order and Propositional Theories
[MacCartney etal. '03]	B. MacCartney, S. McIlraith, E. Amir, & T. Uribe	Practical Partition-Based Theorem Proving for Large Knowledge Bases
[Amir & Engelhardt '03]	Eyal Amir and Barbara Engelhardt	Factored Planning
[Rish & Dechter '00]	Irina Rish and Rina Dechter	Resolution versus Search: Two Strategies for SAT
[Doucet etal '00]	Arnaud Doucet, Nando de Freitas, Kevin Murphy, Stuart Russell	Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks, Tutorial, and slides
[Doucet etal '00b]	Arnaud Doucet, Simon Godsill, and Christophe Andrieu	On sequential Monte-Carlo sampling methods for Bayesian filtering
[Coates '04]	Mark Coates	Distributed particle filters for sensor networks
[Fox etal '01]	Dieter Fox, Sebastian Thrun, Wolfram Burgard, Frank Dellaert	Particle Filters for Mobile Robot Localization
[Moskewicz etal '01]	M. W. Moskewicz, C. F. Madigan, Y. Zhao, L. Zhang, and S. Malik	Chaff: engineering an efficient SAT solver
[Ginsberg and McAllester '94]	M. Ginsberg and D. McAllester	GSAT and Dynamic Backtracking
[Selman, Mitchell, and Levesque '97]	B. Selman, D. Mitchell, and H. Levesque	Generating hard satisfiability problems
[MacKay '98]	David MacKay	Introduction to Monte Carlo methods
[Crick & Pfeffer '03]	Christopher Crick and Avi Pfeffer	Loopy belief propagation as a basis for communication in sensor networks
[Yedidia etal. '03]	J.S. Yedidia, W.T. Freeman and Y. Weiss	Bethe free energy, Kikuchi approximations and belief propagation algorithms
[McEliece, MacKay & Cheng '98]	R.J. McEliece, D. J. C. MacKay, and J. F. Cheng	Turbo decoding as an instance of Pearl's `belief propagation
[Poole '03]	David Poole	First-order probabilistic inference
[Braunstein etal '03]	A. Braunstein, M. Mezard, R. Zecchina	Survey propagation: an algorithm for satisfiability
[Amir & Russell '03]	E. Amir and S. Russell	Logical Filtering
[Jaakola '00]	T. Jaakola	Tutorial on variational approximation methods (slides)
[El-Hay & Friedman '01]	T. El-Hay and N. Friedman	Incorporating Expressive Graphical Models in Variational Approximations: Chain-Graphs and Hidden Variables
[Tu & Zhu '02]	Zhuowen Tu and Song-Chun Zhu	Image Segmentation by Data-Driven Markov Chain Monte Carlo
[Wei & Altman '97]	L. Wei and R. B. Altman	An Automated System for Generating Comparative Disease Profiles and Making Diagnoses
[Segal etal. '03]	E. Segal and R. Yelensky and D. Koller	Genome-wide Discovery of Transcriptional Modules from DNA Sequence and Gene Expression
[Baumgartner '00]	Peter Baumgartner	FDPLL - A First-Order Davis-Putnam-Logeman-Loveland Procedure
[Khan etal. '03]	Z. Khan, T. Balch, and F. Dellaert	An MCMC-based Particle Filter for Tracking Multiple Interacting Targets
[Marthi etal. '03]	B. Marthi, H. Pasula, and S. Russell	Decayed MCMC Filtering
[Pfeffer '00]	A. Pfeffer	Probabilistic Reasoning for Complex Systems
[Pasula & Russell '00]	H. Pasula and S. Russell	Approximate Inference For First-Order Probabilistic Languages
[Pasula etal. '02]	H. Pasula, B. Marthi, B. Milch, S. Russell, I. Shpitser	Identity Uncertainty and Citation Matching
[del Val '99]	A. del Val	A New Method for Consequence Finding and Compilation for Restricted Languages
[de Kleer '92]	J. de Kleer	An Improved Incremental Algorithm for Generating Prime Implicates
[Slagle etal. '70]	J.R. Slagle, C.-L. Chang and R. Lee	A new algorithm for generating prime implicants
[Groote & Zantema '00]	J.F. Groote and H. Zantema	Resolution and binary decision diagrams cannot simulate each other polynomially
[Groote & Tveretina '03]	J.F. Groote and O. Tveretina	Binary decision diagrams for first-order predicate logic
[Sanghai, Domingo, & Weld '03]	S. Sanghai, P. Domingo, and D. Weld	Dynamic Probabilistic Relational Models
[Rabiner '89]	L.R. Rabiner	A tutorial on hidden Markov models and selected applications in speech recognition
[Lerner & Parr '01]	U. Lerner and R. Parr	Inference in Hybrid Networks: Theoretical Limits and Practical Algorithms
Key	Authors	Title
Key	Authors	Title
Key	Authors	Title
Key	Authors	Title
Key	Authors	Title
Key	Authors	Title

Viewing PostScript and PDF

Depending on the computer you are using, you may be able to download a PostScript viewer or PDF viewer for it if you don't already have one.