clean up, and adding more tests

.gitignore

@@ -66,3 +66,5 @@ _templates
 
 # our virtual environment
 p37
+
+data

.gitmodules

@@ -0,0 +1,3 @@
+[submodule "data/treebank_data"]
+ path = data/treebank_data
+ url = https://github.com/PerseusDL/treebank_data.git

README.md

@@ -7,6 +7,7 @@ Practical ML with examples. Support for articles, arguments, and tutorials.
 * Interesting applications of Natural Language Processing and Machine Learning.
 * Practical demonstration notebooks
 * Longer methods and code extracted from the notebooks for type checking, linting, testing and increased robustness.
+* Reproducible experiments
 * Type checking via MyPy annotations
 * Linting via Pylint
 * Doctests whenever possible
@@ -16,9 +17,9 @@ Practical ML with examples. Support for articles, arguments, and tutorials.
 ### Install Python 3
 ### Create Virtual Environment
 ``` 
-mkdir p37
- `which python3` -m venv ./p37
- source p37/bin/activate
+mkdir p3
+ `which python3` -m venv ./p3
+ source p3/bin/activate
 ```
 ### Install Requirements
 
@@ -44,8 +45,6 @@ mkdir p37
 * [1. Assessing Corpus Quality](building_language_model/assessing_corpus_quality.ipynb)
 * [2. Making a Frequency Distribution](building_language_model/make_frequency_distribution.ipynb)
 * [3. Making a Trie Language Model](building_language_model/make_trie_language_model.ipynb)
-### Bootstrapping Classification
-* [4. Bootstrapping - Classifying Corpus Documents](bootstrapping_classification/corpus_doc_classify.ipynb)
 ### Detecting Loanwords
 * [5. Making a Frequency Distribution of Transliterated Greek](detecting_loanwords/make_frequency_distribution_greek_transliterated.ipynb)
 * [6. Boosting Training Data](detecting_loanwords/boosting_training_data.ipynb)