239 Commits

Author	SHA1	Message	Date
Tilman Kamp	6b1d6773de	SDB support	2020-03-10 10:32:58 +01:00
Reuben Morais	cedd72da9b	Force UTF-8 IO encoding	2020-02-17 10:46:40 +01:00
Reuben Morais	f32fd7a33f	Add transfer learning test	2020-02-17 08:29:10 +01:00
JRMeyer	5bba9ea5d1	Transfer-learning support	2020-02-17 08:29:10 +01:00
Alexandre Lissy	95b931df4f	Use other storage for TrainingSpeech dataset ... Fixes #2715 X-DeepSpeech: NOBUILD	2020-02-13 20:26:25 +01:00
Reuben Morais	1e2eb96248	Update all API consumers	2020-02-11 19:44:36 +01:00
Alexandre Lissy	dc25509950	Remove unused benchmark_nc	2020-01-30 08:47:59 +01:00
Tilman Kamp	ad9f0c581b	Introducing utils.helpers for miscellaneous helper functions	2020-01-14 16:04:18 +01:00
Alexandre Lissy	581515e094	Add 8kHz training test coverage ... Fixes #2638	2020-01-10 14:51:45 +01:00
Tilman Kamp	259a60b7b1	Implements #2624 - SWC importer: CSV columns for article and speaker	2019-12-31 16:23:37 +01:00
Reuben Morais	fa8061022e	Use data/smoke_test in tests to avoid depending on LDC servers	2019-12-13 12:48:05 +01:00
Reuben Morais	551570616b	Reduce training task from 399 epochs to 220, enough to overfit LDC93S1	2019-12-03 13:07:15 +01:00
Alexandre Lissy	fe6230020c	Support packaging as Zip file	2019-11-13 11:16:11 +01:00
Tilman Kamp	343d07173f	Fix: ms per char minimum for SWC and TUDA importers	2019-11-06 13:14:55 +01:00
Reuben Morais	3fdc7d422d	Remove alphabet param usage	2019-11-05 09:02:42 +01:00
Tilman Kamp	96a720c597	Relative paths in M-AILAB importer	2019-10-30 16:18:14 +01:00
Tilman Kamp	df1df83720	Fix for empty skip list case; making linter happy	2019-10-30 12:59:16 +01:00
Tilman Kamp	cf6245847f	Added executable flag to some importers	2019-10-28 14:33:40 +01:00
Tilman Kamp	cef7c45f03	Making sample paths relative; additional sub-sets	2019-10-28 12:25:12 +01:00
Tilman Kamp	2cdfcff4c6	TUDA importer	2019-10-25 14:57:25 +02:00
Tilman Kamp	4be08fa6d3	Removed dutch ij digraph from normalization blacklist	2019-10-24 12:43:38 +02:00
Tilman Kamp	122a007d33	Linter induced changes	2019-10-23 16:47:50 +02:00
Tilman Kamp	010f24578f	Better alphabet access	2019-10-23 15:10:08 +02:00
Tilman Kamp	3424ab2b5d	Spoken Wikipedia importer	2019-10-23 14:22:37 +02:00
Reuben Morais	f0688ec941	Add Alphabet.encode analog to .decode and better encapsulate implementation details	2019-10-23 11:22:56 +02:00
Murcurio	9055d49b47	Update import_cv2.py ... Requires utf8 encoding, without this it tries to read it as ascii and fails	2019-10-18 12:49:33 +11:00
mone27	a867c919bd	Setted default param of skiplist to '' ... fixing issue found in https://github.com/MozillaItalia/DeepSpeech-Italian-Model/pull/21	2019-10-11 16:42:32 +02:00
Alexandre Lissy	9ce8c24165	Move from Markdown to reStructuredText	2019-10-04 12:07:32 +02:00
Alexandre Lissy	0ac4df6f82	Add M-AILABS importer	2019-10-02 13:40:19 +02:00
Alexandre Lissy	e22f9787be	Add SLR57 importer: African Accented French	2019-10-02 13:40:19 +02:00
Richard Hamnett	792d8e0a27	Create import_vctk.py	2019-09-21 20:46:55 +01:00
Reuben Morais	150fb67a02	Validate WAV header duration against file size ... X-DeepSpeech: NOBUILD	2019-09-12 10:16:54 +00:00
Reuben Morais	fcb9bf6d9f	Also remove samples with noise ... X-DeepSpeech: NOBUILD	2019-09-11 09:02:21 +00:00
Reuben Morais	732d0b221d	Add MAGICDATA importer	2019-09-11 10:06:44 +02:00
Reuben Morais	670e06365e	Run tf_upgrade_v2 on our code	2019-08-28 17:53:24 +02:00
Richard Hamnett	57156fffd0	Update import_voxforge.py ... Fix importer	2019-08-18 09:44:12 +01:00
Reuben Morais	5c8af86aca	Merge pull request #2200 from rhamnett/patch-2 ... Allow for different sample rate exports	2019-07-04 15:04:22 +00:00
Reuben Morais	182c405eeb	Merge pull request #2160 from mozilla/more-mandarin-importers ... More mandarin importers	2019-06-27 17:43:24 +00:00
Reuben Morais	67b4f6826a	Add importer for aidatatang_200zh corpus	2019-06-27 14:40:20 -03:00
Reuben Morais	67a769e0d7	Add importer for Free ST Chinese Mandarin Corpus	2019-06-27 14:40:20 -03:00
Reuben Morais	ee78d471a2	Add importer for Primewords Chinese Corpus Set 1	2019-06-27 14:40:20 -03:00
Richard Hamnett	c248ed0435	Allow for different sample rate exports ... Sets output format to Sox transformer	2019-06-23 19:47:12 +01:00
Reuben Morais	4b305d2f5e	Remove --use_seq_length flag	2019-06-18 19:38:59 -03:00
Alexandre Lissy	f33ead8af9	Frame counter should be initialized on all importers ... Fixes #2150	2019-06-09 07:43:58 +02:00
Alexandre Lissy	1313b51a5d	Ensure frames counter is initialized ... Fixes #2150	2019-06-06 10:42:26 +02:00
Alexandre Lissy	32a73b7224	Do not fail without --bogus-records	2019-06-05 16:04:45 +02:00
Alexandre Lissy	3a17896463	Do not import known bogus Lingua Libre records ... Fixes #2147	2019-06-04 18:45:34 +02:00
Alexandre Lissy	17e3f284a5	Computing audio hours at import	2019-05-28 16:46:20 +02:00
Arey	8f806f7a3a	fit PEP8	2019-05-22 13:05:17 +08:00
Arey	fbedbbc9f9	make flag name more explicit	2019-05-22 12:47:11 +08:00