User Tools

Site Tools


cs501r_f2016:fp

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
cs501r_f2016:fp [2016/11/22 16:03]
wingated
cs501r_f2016:fp [2021/06/30 23:42] (current)
Line 6: Line 6:
 ====Deliverable:​==== ====Deliverable:​====
  
-For your final project, you should execute a substantial project of your own choosing. ​ You will turn in a single writeup (in PDF format only, please!). ​ Your writeup can be structured in whatever way makes sense for your project, but see below for some possible outlines (for example, ​the outline of your project could closely follow the grading standards).+There are two deliverables ​for the final:
  
-**Your project will be graded more on effort than results.** ​ As I have stated in class, I would rather have you swing for the fences and miss, than take on a simplesafe project. ​ **It is therefore very important that your final writeup ​clearly convey the scope of your efforts.** +  ​An excel spreadsheet (or CSV file) that shows the total amount of time you spent on your finalbroken down by day 
- +  ​* ​A PDF writeup of your project ​(one page)
-I am expecting some serious effort on this project, so I am expecting a writeup that reflects that.  There are no fixed page limits, but I would guess that about 8-10 pages would be good.+
  
 ---- ----
 ====Grading standards:​==== ====Grading standards:​====
  
-Your writeup will be graded on the following ​elements:+Your final project counts as 20% of your overall grade. 
 + 
 +Grading is divided into two parts: 80% of your final project grade is based on the number of hours you spent, and 20% is based on your writeup
 + 
 +For the number of hours, I will take the total number of hours and divide by 35, then multiply by 100 (and capped at 100%). ​ This will be your percentage. ​ (So, 35 hours == 100%, 17.5 hours == 50%, etc.) 
 + 
 +I will evaluate your writeup primarily based on the quality of your writing, although I reserve the right to assign some points based on the quality of your project. 
 + 
 +**Note that no late submissions are possible for this project, because it is done in lieu of the final exam.** 
 + 
 +---- 
 +====Description:​==== 
 + 
 +For your final project, you should execute a substantial project of your own choosing. ​ You will turn in a single writeup (in PDF format only, please!). ​ Your writeup can be structured in whatever way makes sense for your project, but see below for some possible outlines. 
 + 
 +**Your project ​will be graded ​more on effort than results.** ​ As I have stated in class, I would rather have you swing for the fences and miss, than take on a simple, safe project. ​ **It is therefore very important that your final time log clearly convey the scope of your efforts.** 
 + 
 +I am expecting some serious effort on this project, so I am expecting that your writeup, even if it's short, reflects that. 
 + 
 +---- 
 +====Requirements for the time log:==== 
 + 
 +For the time log, you must document the time you spent (on a daily basis) along with a simple description of your activities during that time.  **If you do not document your time, it will not count.** ​ In other words, it is not acceptable to claim that you spent 35 hours on your project, without a time log to back it up.  I will not accept any excuses about this requirement. 
 + 
 +So, for example, a time log might look like the following: 
 + 
 +  * 8/11 - 1 hour - read alphago paper 
 +  * 8/12 - 2 hours - downloaded and cleaned data 
 +  * 8/21 - 4 hours - found alphago code 
 +  * 8/24 - 1 hour - implemented game logic 
 +  * 9/17 - 2 hours - worked on self-play engine 
 +  * 9/18 - 1 hour - worked on self-play engine 
 +  * 10/1 - 2 hours - started training 
 +  * ... etc. 
 + 
 +Additional requirements:​ 
 + 
 +  * You may not count any more than 5 hours of research and reading 
 +  * You may not count any more than 15 hours of "prep work"​. ​ This could include dataset preparation,​ collection and cleaning; or wrestling with getting a simulator / model working for a deep RL project; etc. 
 +  * At least 20 hours must involve designing, testing, and iterating deep learning-based models, analyzing results, experimenting,​ etc. 
 +  * You don't get extra credit for more than 35 hours. ​ Sorry. ​ :) 
 + 
 +---- 
 +====Requirements for the writeup:​==== 
 + 
 +Your writeup serves to inform me about what you did, and simply needs to describe what you did for your project. ​ You should describe: 
 + 
 +  * The problem you set out to solve 
 +  * The exploratory data analysis you did 
 +  * Your technical approach 
 +  * Your results
  
-  * 5% Clearly motivated problem and background. ​ Do a literature search. ​ What other attempts have been made to solve this problem? +It should ​be about 1-2 pages.
-  * 10% Exploratory data analysis. ​ What patterns exist in the data before applying DNNs?  Is there any pre-processing you need to do? +
-  * 35% Description of technical approach +
-    * 5% How will you know if you succeed? ​ Are there quantitative metrics for success (such as a classification error rate), or will success ​be judged qualitatively (such as the image quality of GAN-generated images)? +
-    * 10% How did you prepare and analyze your data?  How did you establish baselines, and test/train splits? +
-    * 15% Describe how  DNNs fit into your solution method. ​ Discuss whether this is a supervised, unsupervised,​ or RL problem. +
-    * 5% Is there anything unique about your problem, or about the way you applied DNNs?   +
-  * 45% Analysis of results +
-    * 25% Present your final results, including comparison to baselines, in whatever format is most appropriate to your problem +
-    * 20% Describe the process of getting to your final result. ​ What did you tweak? ​ Did you iterate on your topology? ​ How did you debug your model? ​ Include anything relevant to support your discussion, such as tensorboard screenshots,​ graphs of cost decreasing over time, charts comparing different topologies, etc. +
-  * 5% Tidy and legible final writeup+
  
 ---- ----
Line 65: Line 104:
     - Before you start coding, you should look at the data.  What does it include? ​ What patterns do you see?     - Before you start coding, you should look at the data.  What does it include? ​ What patterns do you see?
     - Any visualizations about the data you deem relevant     - Any visualizations about the data you deem relevant
-  - **A clear, technical description of your approach.** ​ This section should include:+  - **A clear, technical description of your approach.** ​
     - Background on the approach     - Background on the approach
     - Description of the model you use     - Description of the model you use
     - Description of the inference / training algorithm you use     - Description of the inference / training algorithm you use
     - Description of how you partitioned your data into a test/​training split     - Description of how you partitioned your data into a test/​training split
 +    - How many parameters does your model have?  What optimizer did you use?
 +    - What topology did you choose, and why?
 +    - Did you use any pre-trained weights? ​ Where did they come from?
   - **An analysis of how your approach worked on the dataset**   - **An analysis of how your approach worked on the dataset**
     - What was your final RMSE on your private test/​training split?     - What was your final RMSE on your private test/​training split?
cs501r_f2016/fp.1479830625.txt.gz · Last modified: 2021/06/30 23:40 (external edit)