Data Science: Capstone Part 2: Dataset + Data Collection
Overview
Based on the feedback you received from your lightning talk, choose one of your topic areas to move forward. For Part 2, you’ll need to collect, clean, and document the dataset(s) you intend to use for your project.
This is not always a trivial task. Remember that data acquisition, transformation, and cleaning are typically the most time-consuming parts of data science projects, so don’t procrastinate!
Once you have your data, read into it and review it to confirm whether it is as productive as you intended. If not, switch datasets, gather additional data (e.g. multiple datasets), or revise your project goals.
Create your own database and data dictionary, then clean and munge your data as appropriate. Finally, document your work so far.
Goal: Find the data you need for your project, clean, and document it.
Requirements
- Find and Clean Your Data: Source and format the required data for your project.
- Create a database
- Create a data dictionary
- Perform preliminary data munging and cleaning of your data: organize your data relevant to your project goals.
- Review data to verify initial assumptions
- Clean and munge data as necessary
- Describe your data: keep your intended audience(s) in mind.
- Document your work so far in a Jupyter notebook.
Bonus
- Document your project goals (revise from your initial pitch)
- Articulate “Specific aim”
- Outline proposed methods and models
- Define risks & assumptions
- Create a blog post of at least 500 words that describes your work so far. Link to it in your Jupyter notebook.
Deliverable Format & Submission
- Table, file, or database with relevant text file or notebook description.
Suggested Ways to Get Started
- Review your initial proposal topic and feedback, and revise accordingly.
- Spend time with your data and verify that it can help you accomplish the goals you set out to pursue.
- If not, document how you intend to either change those goals.
- Alternatively, go find some additional data and/or try another source.
Useful Resources
Project Feedback + Evaluation
You will be evaluated on the requirements above using the below rubric.
RUBRIC
| Score | Interpretation | | — | — | | 0 | Project fails to meet the minimum requirements for this item. | | 1 | Project meets the minimum requirements for this item, but falls significantly short of portfolio-ready expectations. | | 2 | Project exceeds the minimum requirements for this item, but falls short of portfolio-ready expectations. | | 3 | Project meets or exceeds portfolio-ready expectations; demonstrates a thorough understanding of every outlined consideration. |