25 Commits

Author	SHA1	Message	Date
Reuben Morais	9c401d15f8	WIP use static libraries from bazel instead of replicating build system	2020-07-03 11:34:42 +02:00
Reuben Morais	a84abf813c	Deduplicate Alphabet implementations, use C++ one everywhere	2020-06-30 09:52:45 +02:00
Reuben Morais	f82c77392d	Rewrite data/lm/generate_package.py into native_client/generate_scorer_package.cpp	2020-06-30 09:52:44 +02:00
Alexandre Lissy	6c2cbbd725	Fix #3053: Check output stream when producing scorer	2020-06-16 23:28:01 +02:00
Reuben Morais	efbed73d5c	Improve error handling around Scorer loading	2020-02-11 19:44:36 +01:00
Reuben Morais	1e2eb96248	Update all API consumers	2020-02-11 19:44:36 +01:00
Reuben Morais	ab08f5ee5a	Change decoder API	2020-02-11 19:44:26 +01:00
Reuben Morais	b33d90b7bd	Load combined format from Scorer	2020-02-11 19:44:26 +01:00
Reuben Morais	214b50f490	Add generate_package tool to create combined scorer package	2020-02-11 19:44:26 +01:00
Reuben Morais	be2229ef29	Refactor Scorer so model/trie package can be created by an external tool	2020-02-11 19:44:26 +01:00
Reuben Morais	0e6952c3a8	Avoid reconstructing strings twice on decode	2019-11-11 12:53:05 +01:00
Reuben Morais	c1b1a59423	Score prefix as soon as a grapheme is formed rather than 1 byte later	2019-11-11 12:52:48 +01:00
Reuben Morais	f4cdd988df	UTF-8 target	2019-11-11 11:36:16 +01:00
Reuben Morais	6dba6d4a95	Don't explicitly score the BOS token, and avoid copies when scoring sentences	2019-09-26 14:08:32 +02:00
Reuben Morais	89f63dcd69	Make Scorer init fallible and check it in callers	2019-08-26 13:59:15 +02:00
Reuben Morais	1b18494e63	Address review comments	2019-08-23 12:19:32 +02:00
Reuben Morais	4dabd248bc	Make Alphabet copyable and default-constructable and avoid pointers	2019-08-23 12:19:32 +02:00
Reuben Morais	31afc6811f	Switch to ConstFst from VectorFst and mmap trie file when reading	2019-06-21 22:21:19 -03:00
Reuben Morais	a5bcecbe40	Address more review comments	2018-11-11 15:24:31 -02:00
Reuben Morais	3255f23426	ctcdecode binding fixes	2018-11-08 18:14:32 -02:00
Reuben Morais	23497fde41	Use unique_ptr for Scorer members	2018-10-30 09:21:30 -03:00
Reuben Morais	68258e356c	Address review comments	2018-10-29 23:57:14 -03:00
Reuben Morais	db3a36c36b	Remove leftover hack making Scorer members public	2018-10-25 22:29:23 -03:00
Reuben Morais	770d742cd5	Adjust ctcdecode to use our Alphabet code, support using trie files	2018-10-25 17:01:05 -03:00
Reuben Morais	c34fc5b7ac	Import parlance/ctcdecode into repository	2018-10-25 17:00:48 -03:00