Commit Graph

81 Commits

Author SHA1 Message Date
Reuben Morais
33760a6bcd Delay beam expansion until a non-blank label has probability >0.1% 2020-04-17 14:33:40 +02:00
Reuben Morais
5fa1839a7f Use Alphabet to compute string values in get_prev_* 2020-04-13 10:23:23 +02:00
Alexandre Lissy
d8d5e6f358 Fix #2885: Improve ds-swig integration 2020-04-08 18:48:12 +02:00
Alexandre Lissy
1598be8124 Add CTC decoder build on TaskCluster 2020-03-25 09:35:12 +01:00
lissyx
c8046cbff0
Fix -fPIC typo 2020-03-25 09:18:58 +01:00
Ryoji Yoshida
4ffbd46cea Address review comments 2020-03-25 10:33:22 +09:00
Ryoji Yoshida
d7cca2a791 Support building ctc_decoder wheel package on Windows system 2020-03-24 09:48:30 +09:00
Reuben Morais
2ec34d5a06 Address review comments 2020-03-17 14:48:31 +01:00
Reuben Morais
69bd032605 Improve API naming around Metadata objects 2020-03-17 14:47:58 +01:00
dabinat
e0c42f01a4 Moved result limiting to ModelState instead of CTC decoder 2020-03-17 14:47:58 +01:00
dabinat
32c969c184 Expose multiple transcriptions through the API 2020-03-17 14:47:58 +01:00
Alexandre Lissy
0add08e30d Ensure python builds uses all ressources 2020-02-14 18:55:03 +01:00
Reuben Morais
8dedda7759 Address review comments 2020-02-11 19:44:36 +01:00
Reuben Morais
1d3b3a31a1 Address review comments and update docs 2020-02-11 19:44:36 +01:00
Reuben Morais
efbed73d5c Improve error handling around Scorer loading 2020-02-11 19:44:36 +01:00
Reuben Morais
1e2eb96248 Update all API consumers 2020-02-11 19:44:36 +01:00
Reuben Morais
ab08f5ee5a Change decoder API 2020-02-11 19:44:26 +01:00
Reuben Morais
16d5632d6f Write default values for alpha and beta into trie header 2020-02-11 19:44:26 +01:00
Reuben Morais
b33d90b7bd Load combined format from Scorer 2020-02-11 19:44:26 +01:00
Reuben Morais
214b50f490 Add generate_package tool to create combined scorer package 2020-02-11 19:44:26 +01:00
Reuben Morais
be2229ef29 Refactor Scorer so model/trie package can be created by an external tool 2020-02-11 19:44:26 +01:00
Reuben Morais
7c0354483e Stop including vocabulary data in LM.binary. 2020-02-11 19:44:19 +01:00
Alexandre Lissy
ff401732a3 Enforce CTC decoder version check
Fix #2710
2020-02-03 10:24:21 +01:00
Alexandre Lissy
f44d2ddeb9 Don't OOV_SCORE on empty prefix
Fixes #2579
2020-01-02 12:39:12 +01:00
Reuben Morais
d2eb305b73 Address review comment and add missing check for presence of scorer 2019-11-12 21:56:42 +01:00
Reuben Morais
0e6952c3a8 Avoid reconstructing strings twice on decode 2019-11-11 12:53:05 +01:00
Reuben Morais
c1b1a59423 Score prefix as soon as a grapheme is formed rather than 1 byte later 2019-11-11 12:52:48 +01:00
Reuben Morais
f4cdd988df UTF-8 target 2019-11-11 11:36:16 +01:00
Reuben Morais
ae705cf95f Remove first party code from common.a 2019-11-08 14:33:06 +01:00
Reuben Morais
8c82081779 Embed alphabet directly in model 2019-11-05 09:02:21 +01:00
lissyx
969146c908
Merge pull request #2462 from lissyx/py38
Build Python 3.8 wheels
2019-10-25 19:15:40 +02:00
Alexandre Lissy
f80dbcda75 Build Python 3.8 wheels
Fixes #2461
2019-10-25 12:28:27 +02:00
Reuben Morais
44a605c8b7
Merge pull request #2435 from mozilla/uplift-utf8-fixes
Uplift general fixes from UTF-8 work
2019-10-25 09:09:48 +00:00
Alexandre Lissy
ef3f8004ce Use std::shared_ptr instead of raw pointer for dictionary_
Fixes #2403
2019-10-18 10:15:59 +02:00
Reuben Morais
31d81740ee Add debugging helpers to PathTrie 2019-10-15 12:49:38 +02:00
Reuben Morais
abc687b3b9 Specify BOS for final scoring at decode if applicable 2019-10-14 21:03:14 +02:00
Reuben Morais
c8802a38e7 Don't add special tokens to vocabulary 2019-10-14 21:03:14 +02:00
Reuben Morais
3015237e8d Replace incomplete sorts with partial sorts 2019-10-14 21:03:14 +02:00
Reuben Morais
aad1b2234b Debug build for ds_ctcdecoder package 2019-10-11 18:01:02 +02:00
Reuben Morais
67e3eefb95 Remove incorrect docs on Scorer
X-DeepSpeech: NOBUILD
2019-09-30 10:54:59 +02:00
Reuben Morais
ba56407376
Merge pull request #2383 from mozilla/scorer-cleanup
Don't explicitly score the BOS token, and avoid copies when scoring sentences
2019-09-27 11:06:24 +02:00
Reuben Morais
a323973521 Address review comments 2019-09-27 11:02:22 +02:00
Alexandre Lissy
86b44a7cb7 Load KenLM with LAZY
Fixes #2384
2019-09-26 21:08:27 +02:00
Reuben Morais
6dba6d4a95 Don't explicitly score the BOS token, and avoid copies when scoring sentences 2019-09-26 14:08:32 +02:00
Reuben Morais
0ac498bc50 Rename metadata probability field to confidence 2019-09-11 11:09:44 +02:00
Reuben Morais
89f63dcd69 Make Scorer init fallible and check it in callers 2019-08-26 13:59:15 +02:00
Reuben Morais
1b18494e63 Address review comments 2019-08-23 12:19:32 +02:00
Reuben Morais
b2ef9cca83 Make Alphabet init fallible and check it in model creation 2019-08-23 12:19:32 +02:00
Reuben Morais
4dabd248bc Make Alphabet copyable and default-constructable and avoid pointers 2019-08-23 12:19:32 +02:00
Reuben Morais
4d882a8aec Simplify decoder impl by making it object oriented, avoid pointers where possible 2019-08-23 12:19:32 +02:00