From 715b8c52ec292c693aa6e397bb5a5f1aad65fb0c Mon Sep 17 00:00:00 2001 From: josh Date: Thu, 28 Feb 2019 01:42:16 +0100 Subject: [PATCH 1/3] short readme for data dir --- data/README.md | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 data/README.md diff --git a/data/README.md b/data/README.md new file mode 100644 index 00000000..eeaea311 --- /dev/null +++ b/data/README.md @@ -0,0 +1,9 @@ +# Language-Specific Data + +This directory contains language-specific data files. Most importantly, you will find here: + +1. a list of unique characters for the target language (e.g. English) in `data/alphabet.txt` +2. a binary n-gram language model compiled by `kenlm` in `data/lm/lm.binary` +3. a trie model compiled by `kenlm` in `data/lm/trie` + +For more information on how to create these resources, see `data/lm/README.md` From c3ce06ede9d2ac98f9c1757690839847d6179726 Mon Sep 17 00:00:00 2001 From: Josh Meyer Date: Mon, 18 Mar 2019 23:53:28 +0100 Subject: [PATCH 2/3] generate_trie, not kenlm --- data/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/data/README.md b/data/README.md index eeaea311..13df6900 100644 --- a/data/README.md +++ b/data/README.md @@ -4,6 +4,6 @@ This directory contains language-specific data files. Most importantly, you will 1. a list of unique characters for the target language (e.g. English) in `data/alphabet.txt` 2. a binary n-gram language model compiled by `kenlm` in `data/lm/lm.binary` -3. a trie model compiled by `kenlm` in `data/lm/trie` +3. a trie model compiled by `generate_trie.cpp` in `data/lm/trie` For more information on how to create these resources, see `data/lm/README.md` From 73ebc5027770dec80837f495f44a82fa4adf6434 Mon Sep 17 00:00:00 2001 From: Josh Meyer Date: Mon, 18 Mar 2019 23:54:42 +0100 Subject: [PATCH 3/3] capitalize --- data/README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/data/README.md b/data/README.md index 13df6900..900ce9ad 100644 --- a/data/README.md +++ b/data/README.md @@ -2,8 +2,8 @@ This directory contains language-specific data files. Most importantly, you will find here: -1. a list of unique characters for the target language (e.g. English) in `data/alphabet.txt` -2. a binary n-gram language model compiled by `kenlm` in `data/lm/lm.binary` -3. a trie model compiled by `generate_trie.cpp` in `data/lm/trie` +1. A list of unique characters for the target language (e.g. English) in `data/alphabet.txt` +2. A binary n-gram language model compiled by `kenlm` in `data/lm/lm.binary` +3. A trie model compiled by `generate_trie.cpp` in `data/lm/trie` For more information on how to create these resources, see `data/lm/README.md`