This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | |||
cs501r_f2018:lab3 [2018/09/19 04:43] rpottorff |
cs501r_f2018:lab3 [2018/09/20 15:50] sadler [Detailed specs:] |
||
---|---|---|---|
Line 42: | Line 42: | ||
https://pytorch.org/docs/stable/torch.html#torch.log | https://pytorch.org/docs/stable/torch.html#torch.log | ||
- | **Part 2:** Implement a few initialization strategies including Xe initialization (sometimes called Xavier), Orthogonal initailization, and uniform random. You can specify which strategy you want to use with a parameter. Helpful links include: | + | **Part 2:** Implement a few initialization strategies which can include Xe initialization (sometimes called Xavier), Orthogonal initailization, and uniform random. You can specify which strategy you want to use with a parameter. Helpful links include: |
https://hjweide.github.io/orthogonal-initialization-in-convolutional-layers (or the orignal paper: http://arxiv.org/abs/1312.6120) | https://hjweide.github.io/orthogonal-initialization-in-convolutional-layers (or the orignal paper: http://arxiv.org/abs/1312.6120) | ||
http://andyljones.tumblr.com/post/110998971763/an-explanation-of-xavier-initialization | http://andyljones.tumblr.com/post/110998971763/an-explanation-of-xavier-initialization |