list of figures
preface
1 probability theory
 1.1 introduction
 1.2 stochastic processes
 1.2.1 in formation sets and a -algebras
 1.2.2 the cantor set
 1.2.3 borel-cantelli lemmas
 1.2.4 distribution functions and stochastic processes
 1.3 conditional expectation
 1.3.1 conditional probability
 1.3.2 conditional expectation
 1.3,3 change of variables
 1.4 notes and further readings
2 wiener processes
 2.1 introduction
 2.2 a heuristic approach
 2.2.1 from random walks to wiener process
 2.2.2 some basic properties of the wiener process
 2.3 markov processes
 2.3.1 introduction
 2.3.2 transition probability
 2.3.3 diffusion processes
 2.4 wiener processes
 2.4.1 how to generate more wiener processes
 2.4.2 differentiability of sample functions
 2.4.3 stopping times
 2.4.4 the zero set
 2.4.5 bounded variations and the irregularity of the
 wiener process
 2.5 notes and further readings
3 stochastic calculus
 3.1 introduction
 3.2 a heuristic approach
 3.2.1 ls �� ��s x ��dws riemarm integrable?
 3.2.2 the choice of�� matters
 3.2.3 in search of the class of functions for a ��s, w��
 3.3 the ito integral
 3.3.1 definition
 3.3.2 martingales
 3.4 lto's lemma: autonomous case
 3.4.1 ito's lemma
 3.4.2 geometric brownian motion
 3.4.3 population dynamics
 3.4.4 additive shocks or multiplicative shocks
 3.4.5 multiple sources of uncertainty
 3.4.6 multivariate lto's lemma
 3.5 ito's lemma for time-dependent functions
 3.5.1 euler's homogeneous differential equation and theheat equation
 3.5.2 black-scholes formula
 3.5.3 irreversible investment
 3.5.4 budget equation for an investor
 3.5.5 ito's lemma: general form
 3.6 notes and further readings
4 stochastic dynamic programming
 4.1 introduction
 4.2 bellman equation
 4.2.1 infinite-horizon problems
 4.2.2 verification theorem
 4.2.3 finite-horizon problems
 4.2.4 existence and differentiability of the valuefunction
 4.3 economic applications
 4.3.1 consumption and portfolio rules
 4.3.2 index bonds
 4.3.3 exhaustible resources
 4.3.4 adjustment costs and ��reversible�� investment
 4.3.5 uncertain lifetimes and life insurance
 4.4 extension: reeursive utility
 4.4.1 bellman equation with recursive utility
 4.4.2 effects of reeursivity: deterministic case
 4.5 notes and further readings
5 how to solve it
 5.1 introduction
 5.2 hara functions
 5.2.1 the meaning of each parameter
 5.2.2 closed-form representations
 5.3 trial and error
 5.3.1 linear-quadratic models
 5.3.2 linear-hara models
 5.3.3 linear-concave models
 5.3,4 nonlinear-concave models
 5.4 symmetry
 5.4.1 linear-quadratic model revisited
 5.4.2 merton's model revisited
 5.4.3 fischer's index bond model
 5.4.4 life insurance
 5.5 the substitution method
 5.6 martingale representation method
 5.6.1 girsanov transformation
 5.6.2 example: a portfolio problem
 5.6.3 which 8 to choose?
 5.6.4 a transformed problem
 5.7 inverse optimum method
 5.7.1 the inverse optimal problem: certainty case
 5.7.2 the inverse optimal problem: stochastic case
 5.7.3 inverse optimal problem of merton's model
 5.8 notes and further readings
6 boundaries and absorbing barriers
 6.1 introduction
 6.2 nonnegativity constraint
 6.2.1 issues and problems
 6.2.2 comparison theorems
 6.2.3 chang and malliaris's reflection method
 6.2.4 inaccessible boundaries
 6.3 other constraints
 6.3.1 a portfolio problem with borrowing cooswaints
 6.3.2 viscosity solutions
 6.4 stopping rules - certainty case
 6.4.1 the baumol-tobin model
 6.4.2 a dynamic model of money demand
 6.4.3 the tree-cutting problem
 6.5 the expected discount factor
 6.5.1 fundamental equation for ex[e��]
 6.5.2 one absorbing barrier
 6.5.3 two absorbing barriers
 6.6 optimal stopping times
 6.6.1 dynamic and stochastic demand for money
 6.6.2 stochastic tree-cutting and rotation problems
 6.6.3 investment timing
 6.7 notes and further readings
a miscellaneous applications and exercises
bibliography
index