Commit Graph

95 Commits

Author SHA1 Message Date
Reuben Morais
9c401d15f8 WIP use static libraries from bazel instead of replicating build system 2020-07-03 11:34:42 +02:00
Reuben Morais
2504360e95 Handle universal newlines in Alphabet file parsing 2020-06-30 09:52:45 +02:00
Reuben Morais
a84abf813c Deduplicate Alphabet implementations, use C++ one everywhere 2020-06-30 09:52:45 +02:00
Reuben Morais
f82c77392d Rewrite data/lm/generate_package.py into native_client/generate_scorer_package.cpp 2020-06-30 09:52:44 +02:00
Alexandre Lissy
bc086ec998 Build DeepSpeech using TensorFlow r2.2 2020-06-22 10:48:12 +02:00
Alexandre Lissy
6c2cbbd725 Fix #3053: Check output stream when producing scorer 2020-06-16 23:28:01 +02:00
Reuben Morais
572963e7bd
Merge pull request #3043 from mozilla/version-not-symlink
Move VERSION and GRAPH_VERSION to training directory
2020-06-08 14:34:28 +02:00
Reuben Morais
daba4278ff Add explanation of SWIG ignore side effects 2020-06-08 13:58:32 +02:00
Reuben Morais
06408b8ddd Flip direction of VERSION and GRAPH_VERSION links 2020-06-08 11:22:24 +02:00
Reuben Morais
53192b68b8 Be more specific in %ignoring symbols since it applies to all imports 2020-06-08 11:20:22 +02:00
Reuben Morais
d548222518 Return raw scores in confidence value 2020-05-27 16:48:57 +02:00
Reuben Morais
50b0b8c010 Propagate error code from load_lm in decoder binding 2020-05-20 12:05:35 +02:00
Reuben Morais
4db20b3cd6 Expose DS error codes in ds_ctcdecoder package 2020-05-18 17:30:48 +02:00
Reuben Morais
7ed900e333 Add better error information in Scorer initialization 2020-05-18 11:19:19 +02:00
Reuben Morais
33760a6bcd Delay beam expansion until a non-blank label has probability >0.1% 2020-04-17 14:33:40 +02:00
Reuben Morais
5fa1839a7f Use Alphabet to compute string values in get_prev_* 2020-04-13 10:23:23 +02:00
Alexandre Lissy
d8d5e6f358 Fix #2885: Improve ds-swig integration 2020-04-08 18:48:12 +02:00
Alexandre Lissy
1598be8124 Add CTC decoder build on TaskCluster 2020-03-25 09:35:12 +01:00
lissyx
c8046cbff0
Fix -fPIC typo 2020-03-25 09:18:58 +01:00
Ryoji Yoshida
4ffbd46cea Address review comments 2020-03-25 10:33:22 +09:00
Ryoji Yoshida
d7cca2a791 Support building ctc_decoder wheel package on Windows system 2020-03-24 09:48:30 +09:00
Reuben Morais
2ec34d5a06 Address review comments 2020-03-17 14:48:31 +01:00
Reuben Morais
69bd032605 Improve API naming around Metadata objects 2020-03-17 14:47:58 +01:00
dabinat
e0c42f01a4 Moved result limiting to ModelState instead of CTC decoder 2020-03-17 14:47:58 +01:00
dabinat
32c969c184 Expose multiple transcriptions through the API 2020-03-17 14:47:58 +01:00
Alexandre Lissy
0add08e30d Ensure python builds uses all ressources 2020-02-14 18:55:03 +01:00
Reuben Morais
8dedda7759 Address review comments 2020-02-11 19:44:36 +01:00
Reuben Morais
1d3b3a31a1 Address review comments and update docs 2020-02-11 19:44:36 +01:00
Reuben Morais
efbed73d5c Improve error handling around Scorer loading 2020-02-11 19:44:36 +01:00
Reuben Morais
1e2eb96248 Update all API consumers 2020-02-11 19:44:36 +01:00
Reuben Morais
ab08f5ee5a Change decoder API 2020-02-11 19:44:26 +01:00
Reuben Morais
16d5632d6f Write default values for alpha and beta into trie header 2020-02-11 19:44:26 +01:00
Reuben Morais
b33d90b7bd Load combined format from Scorer 2020-02-11 19:44:26 +01:00
Reuben Morais
214b50f490 Add generate_package tool to create combined scorer package 2020-02-11 19:44:26 +01:00
Reuben Morais
be2229ef29 Refactor Scorer so model/trie package can be created by an external tool 2020-02-11 19:44:26 +01:00
Reuben Morais
7c0354483e Stop including vocabulary data in LM.binary. 2020-02-11 19:44:19 +01:00
Alexandre Lissy
ff401732a3 Enforce CTC decoder version check
Fix #2710
2020-02-03 10:24:21 +01:00
Alexandre Lissy
f44d2ddeb9 Don't OOV_SCORE on empty prefix
Fixes #2579
2020-01-02 12:39:12 +01:00
Reuben Morais
d2eb305b73 Address review comment and add missing check for presence of scorer 2019-11-12 21:56:42 +01:00
Reuben Morais
0e6952c3a8 Avoid reconstructing strings twice on decode 2019-11-11 12:53:05 +01:00
Reuben Morais
c1b1a59423 Score prefix as soon as a grapheme is formed rather than 1 byte later 2019-11-11 12:52:48 +01:00
Reuben Morais
f4cdd988df UTF-8 target 2019-11-11 11:36:16 +01:00
Reuben Morais
ae705cf95f Remove first party code from common.a 2019-11-08 14:33:06 +01:00
Reuben Morais
8c82081779 Embed alphabet directly in model 2019-11-05 09:02:21 +01:00
lissyx
969146c908
Merge pull request #2462 from lissyx/py38
Build Python 3.8 wheels
2019-10-25 19:15:40 +02:00
Alexandre Lissy
f80dbcda75 Build Python 3.8 wheels
Fixes #2461
2019-10-25 12:28:27 +02:00
Reuben Morais
44a605c8b7
Merge pull request #2435 from mozilla/uplift-utf8-fixes
Uplift general fixes from UTF-8 work
2019-10-25 09:09:48 +00:00
Alexandre Lissy
ef3f8004ce Use std::shared_ptr instead of raw pointer for dictionary_
Fixes #2403
2019-10-18 10:15:59 +02:00
Reuben Morais
31d81740ee Add debugging helpers to PathTrie 2019-10-15 12:49:38 +02:00
Reuben Morais
abc687b3b9 Specify BOS for final scoring at decode if applicable 2019-10-14 21:03:14 +02:00