DeepSpeech/data/lm
2020-02-11 19:44:19 +01:00
..
generate_lm.py Stop including vocabulary data in LM.binary. 2020-02-11 19:44:19 +01:00
lm.binary Stop including vocabulary data in LM.binary. 2020-02-11 19:44:19 +01:00
README.rst Stop including vocabulary data in LM.binary. 2020-02-11 19:44:19 +01:00
trie Filter LM by removing very rare words 2019-11-13 17:38:40 +01:00

lm.binary was generated from the LibriSpeech normalized LM training text, available `here <http://www.openslr.org/11>`_\ , using the `generate_lm.py` script (will generate lm.binary in the folder it is run from). `KenLM <https://github.com/kpu/kenlm>`_'s built binaries must be in your PATH (lmplz, build_binary, filter).

The trie was then generated from the vocabulary of the language model:

.. code-block:: bash

   ./generate_trie ../data/alphabet.txt lm.binary trie