This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
cs401r_w2016:lab10 [2016/03/17 20:38] admin |
cs401r_w2016:lab10 [2016/03/17 20:39] admin |
||
---|---|---|---|
Line 80: | Line 80: | ||
* You will find a description of the complete HMC algorithm in section 5.3.2.1 | * You will find a description of the complete HMC algorithm in section 5.3.2.1 | ||
- | Remember that you will alternate between two steps: | + | Remember that you will alternate between two steps: |
+ | |||
+ | - Sampling the momentum conditioned on the position. This is just sampling from a Gaussian. | ||
+ | - Proposing a new state for the position, given the momentum. This involves integrating the dynamics, and then accepting or rejecting based on integration error. | ||
You will have to tune two parameters in order to implement HMC: the variance of the momentum variables, and the timestep used for integrating the dynamics. Experiment with both, and report your results using plots like those you prepared for Part 1. | You will have to tune two parameters in order to implement HMC: the variance of the momentum variables, and the timestep used for integrating the dynamics. Experiment with both, and report your results using plots like those you prepared for Part 1. | ||
Line 89: | Line 92: | ||
You have now coded two different inference algorithms, and a few variants of each. For this section, you must provide a small write-up that compares and contrasts each. Answer at least the following questions: | You have now coded two different inference algorithms, and a few variants of each. For this section, you must provide a small write-up that compares and contrasts each. Answer at least the following questions: | ||
- | - What was the acceptance rate of each algorithm? (ie, what percentage of proposals were accepted) | + | - What was the acceptance rate of each algorithm? (ie, what percentage of proposals were accepted) |
- | - Why don't some inference algorithms explore both modes of the density? | + | - Why don't some inference algorithms explore both modes of the density? |
- | - Why do some algorithms stay in the same state repeatedly? Is this good or bad? | + | - Why do some algorithms stay in the same state repeatedly? Is this good or bad? |
- | - What were the best values for the variance of the momentum variables and the timestep you found? How did you know that they were good? | + | - What were the best values for the variance of the momentum variables and the timestep you found? How did you know that they were good? |
---- | ---- |