This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
cs501r_f2016:fp [2018/09/21 17:14] wingated |
cs501r_f2016:fp [2018/11/16 22:47] wingated |
||
---|---|---|---|
Line 8: | Line 8: | ||
There are two deliverables for the final: | There are two deliverables for the final: | ||
- | * An excel spreadsheet (or CSV file) that shows the total amount of time you spent on your final, broken down by day | + | * An excel spreadsheet (or CSV file) that shows the total amount of time you spent on your final, broken down by day |
- | * A PDF writeup of your project (one page) | + | * A PDF writeup of your project (one page) |
---- | ---- | ||
Line 17: | Line 16: | ||
Your final project counts as 20% of your overall grade. | Your final project counts as 20% of your overall grade. | ||
- | Your writeup will be graded on the following elements: | + | Grading is divided into two parts: 80% of your final project grade is based on the number of hours you spent, and 20% is based on your writeup. |
- | * 5% Clearly motivated problem and background. Do a literature search. What other attempts have been made to solve this problem? | + | For the number of hours, I will take the total number of hours and divide by 35, then multiply by 100 (and capped at 100%). This will be your percentage. (So, 35 hours == 100%, 17.5 hours == 50%, etc.) |
- | * 10% Exploratory data analysis. What patterns exist in the data before applying DNNs? Is there any pre-processing you need to do? | + | |
- | * 35% Description of technical approach | + | I will evaluate your writeup primarily based on the quality of your writing, although I reserve the right to assign some points based on the quality of your project. |
- | * 5% How will you know if you succeed? Are there quantitative metrics for success (such as a classification error rate), or will success be judged qualitatively (such as the image quality of GAN-generated images)? | + | |
- | * 10% How did you prepare and analyze your data? How did you establish baselines, and test/train splits? | + | **Note that no late submissions are possible for this project, because it is done in lieu of the final exam.** |
- | * 15% Describe how DNNs fit into your solution method. Discuss whether this is a supervised, unsupervised, or RL problem. | + | |
- | * 5% Is there anything unique about your problem, or about the way you applied DNNs? | + | |
- | * 45% Analysis of results | + | |
- | * 25% Present your final results, including comparison to baselines, in whatever format is most appropriate to your problem | + | |
- | * 20% Describe the process of getting to your final result. What did you tweak? Did you iterate on your topology? How did you debug your model? Include anything relevant to support your discussion, such as tensorboard screenshots, graphs of cost decreasing over time, charts comparing different topologies, etc. | + | |
- | * 5% Tidy and legible final writeup | + | |
---- | ---- | ||
====Description:==== | ====Description:==== | ||
- | For your final project, you should execute a substantial project of your own choosing. You will turn in a single writeup (in PDF format only, please!). Your writeup can be structured in whatever way makes sense for your project, but see below for some possible outlines (for example, the outline of your project could closely follow the grading standards). | + | For your final project, you should execute a substantial project of your own choosing. You will turn in a single writeup (in PDF format only, please!). Your writeup can be structured in whatever way makes sense for your project, but see below for some possible outlines. |
+ | |||
+ | **Your project will be graded more on effort than results.** As I have stated in class, I would rather have you swing for the fences and miss, than take on a simple, safe project. **It is therefore very important that your final time log clearly convey the scope of your efforts.** | ||
+ | |||
+ | I am expecting some serious effort on this project, so I am expecting that your writeup, even if it's short, reflects that. | ||
+ | |||
+ | ---- | ||
+ | ====Requirements for the time log:==== | ||
+ | |||
+ | For the time log, you must document the time you spent (on a daily basis) along with a simple description of your activities during that time. **If you do not document your time, it will not count.** In other words, it is not acceptable to claim that you spent 35 hours on your project, without a time log to back it up. I will not accept any excuses about this requirement. | ||
+ | |||
+ | So, for example, a time log might look like the following: | ||
+ | |||
+ | * 8/11 - 1 hour - read alphago paper | ||
+ | * 8/12 - 2 hours - downloaded and cleaned data | ||
+ | * 8/21 - 4 hours - found alphago code | ||
+ | * 8/24 - 1 hour - implemented game logic | ||
+ | * 9/17 - 2 hours - worked on self-play engine | ||
+ | * 9/18 - 1 hour - worked on self-play engine | ||
+ | * 10/1 - 2 hours - started training | ||
+ | * ... etc. | ||
+ | |||
+ | Additional requirements: | ||
+ | |||
+ | * You may not count any more than 5 hours of research and reading | ||
+ | * You may not count any more than 15 hours of "prep work". This could include dataset preparation, collection and cleaning; or wrestling with getting a simulator / model working for a deep RL project; etc. | ||
+ | * At least 20 hours must involve designing, testing, and iterating deep learning-based models, analyzing results, experimenting, etc. | ||
+ | * You don't get extra credit for more than 35 hours. Sorry. :) | ||
+ | |||
+ | ---- | ||
+ | ====Requirements for the writeup:==== | ||
+ | |||
+ | Your writeup serves to inform me about what you did, and simply needs to describe what you did for your project. You should describe: | ||
- | **Your project will be graded more on effort than results.** As I have stated in class, I would rather have you swing for the fences and miss, than take on a simple, safe project. **It is therefore very important that your final writeup clearly convey the scope of your efforts.** | + | * The problem you set out to solve |
+ | * The exploratory data analysis you did | ||
+ | * Your technical approach | ||
+ | * Your results | ||
- | I am expecting some serious effort on this project, so I am expecting a writeup that reflects that. There are no fixed page limits, but I would guess that about 8-10 pages would be good. | + | It should be about 1-2 pages. |
---- | ---- |