Commit Graph

3467 Commits

Author SHA1 Message Date
CatalinVoss
47020e4ecb Add an imap_unordered helper to LimitPool -- I might experiment with this 2020-11-13 19:20:02 -08:00
CatalinVoss
3d2b09b951 Linter seems unhappy with conditional imports. Make gfile a module-level import.
I usually do this as a conditional because tf takes a while to load and it's nice to skip it when you want to run a script that just preps data or something like that, but it doesn't seem like a big deal.
2020-11-13 10:47:06 -08:00
CatalinVoss
2332e7fb76 Linter fix: define self.tmp_src_file_path in init 2020-11-13 10:45:53 -08:00
CatalinVoss
be39d3354d Perform data loading I/O within worker process rather than main process by wrapping Sample 2020-11-12 21:46:39 -08:00
CatalinVoss
fc0b495643 TODO: CSVWriter still totally breaks with remote paths 2020-11-12 16:46:59 -08:00
CatalinVoss
86cba458c5 Fix remote path handling for CSV sample reading 2020-11-12 16:40:59 -08:00
CatalinVoss
8fe972eb6f Fix wave file reading helpers 2020-11-12 16:40:40 -08:00
CatalinVoss
783cdad8db Fix downloader and taskcluster directory mgmt with remote I/O 2020-11-12 16:30:11 -08:00
CatalinVoss
64d278560d Why do we need absolute paths everywhere here? 2020-11-12 16:29:43 -08:00
CatalinVoss
0030cab220 Skip remote zipping for now 2020-11-12 16:29:23 -08:00
CatalinVoss
a6322b384e Fix remote I/O handling in train 2020-11-12 16:29:16 -08:00
CatalinVoss
8f31072998 Fix startswith check 2020-11-12 15:09:42 -08:00
CatalinVoss
90e2e1f7d2 Respect buffering, encoding, newline, closefd, and opener if we're looking at a local file 2020-11-12 14:45:05 -08:00
CatalinVoss
ad08830421 Work remote I/O into audio utils -- a bit more involved 2020-11-12 14:17:03 -08:00
CatalinVoss
3d503bd69e Add universal is_remote_path to I/O helper 2020-11-12 14:16:37 -08:00
CatalinVoss
c3dc4c0d5c Fix bad I/O helper fn replace errors 2020-11-12 14:06:22 -08:00
CatalinVoss
abe5dd2eb4 Remote I/O for taskcluster 2020-11-12 12:49:44 -08:00
CatalinVoss
296b74e01a Remote I/O for sample_collections 2020-11-12 10:54:44 -08:00
CatalinVoss
7de317cf59 Remote I/O for evaluate_tools 2020-11-12 10:49:33 -08:00
CatalinVoss
396ac7fe46 Remote I/O for downloader 2020-11-12 10:48:49 -08:00
CatalinVoss
933d96dc74 Fix relative imports 2020-11-12 10:47:26 -08:00
CatalinVoss
42170a57eb Remote I/O for config 2020-11-12 10:46:49 -08:00
CatalinVoss
83e5cf0416 Remote I/O fro check_characters 2020-11-12 10:46:15 -08:00
CatalinVoss
579921cc92 Work remote I/O into train script 2020-11-12 10:45:35 -08:00
CatalinVoss
53e3f5374f Add I/O helpers for remote file access 2020-11-12 10:44:19 -08:00
lissyx
12badcce1f
Merge pull request #3393 from imrahul361/master
Run test On Java Client
2020-11-05 16:30:41 +01:00
imrahul3610
3ac6b4fda6 Run test On Java Client 2020-11-05 19:10:50 +05:30
lissyx
8f9d6ad024
Merge pull request #3408 from lissyx/pr-3406
Pr 3406
2020-11-05 13:13:40 +01:00
dag7dev
3a2879933f initial commit for py39 support 2020-11-04 20:16:35 +01:00
Reuben Morais
b72e2643c4
Merge pull request #3395 from CatalinVoss/patch-1
Minor Training Variable Consistency fix
2020-11-03 21:50:59 +01:00
Catalin Voss
98e75c3c03
Call the logits probs in create_inference_graph after they go thru softmax 2020-11-03 09:49:27 -08:00
lissyx
19eeadd0f3
Merge pull request #3398 from lissyx/fix-rtd
Force npm install on RTD and set appropriate PATH value
2020-11-03 14:36:47 +01:00
Alexandre Lissy
1cd5e44a52 Force npm install on RTD and set appropriate PATH value 2020-11-03 14:33:52 +01:00
Catalin Voss
9a92fa40ca
Make variables consistent 2020-11-02 21:09:35 -08:00
lissyx
d9a35d63b0
Merge pull request #3390 from JRMeyer/contributing-docs
note about perf testing
2020-10-29 10:27:51 +01:00
Josh Meyer
b732e39567 note about perf testing
X-DeepSpeech: NOBUILD
2020-10-28 10:22:19 -04:00
lissyx
4427cf9a42
Merge pull request #3389 from suriyaa/patch-1
Use HTTPS in README.md
2020-10-27 12:32:04 +01:00
Suriyaa Sundararuban
87c44d75a3
Use HTTPS in README.md 2020-10-27 11:04:32 +01:00
lissyx
e6a281ed4f
Merge pull request #3383 from ftyers/node15
update for NodeJS 15
2020-10-26 18:22:22 +01:00
Francis Tyers
55e31c4025 update for NodeJS 15 2020-10-26 15:44:06 +00:00
lissyx
5e2a916899
Merge pull request #3385 from liezl200/sys-import-voxforge
Add missing sys import to import_voxforge.py
2020-10-23 15:07:02 +02:00
Liezl P
af7c4e90df Add missing sys import to import_voxforge.py 2020-10-22 23:09:49 -10:00
Reuben Morais
0798698e97
Merge pull request #3380 from piraka9011/patch-1
Convert channels for CV2 dataset
2020-10-17 00:43:08 +02:00
Anas Abou Allaban
521842deea
Convert channels for CV2 dataset
When running a training session on the CV2 dataset, it is possible to get the following error:

```
ValueError: Mono-channel audio required
```

This makes the [pysox Transformer](https://pysox.readthedocs.io/en/latest/api.html#sox.transform.Transformer.convert) also convert the channels.
2020-10-15 11:22:39 -04:00
lissyx
e508cd30b7
Merge pull request #3377 from actual-kwarter/master
Minor spelling fixes to CONTRIBUTING.rst X-DeepSpeech: NOBUILD
2020-10-14 10:28:33 +02:00
THCKwarter
e9fc614d8a Minor spelling fixes to CONTRIBUTING.rst X-DeepSpeech: NOBUILD 2020-10-13 22:53:49 -05:00
Reuben Morais
51e351e895
Merge pull request #3370 from tiagomoraismorgado/patch-1
X-DeepSpeech: NOBUILD
2020-10-12 14:18:09 +02:00
tiagomoraismorgado
f753b86ca9
[docs/typos/enhance] - mozilla/deepspeech/readme.rst - update
[docs/typos/enhance] - mozilla/deepspeech/readme.rst - update
2020-10-12 12:46:32 +01:00
lissyx
435b20d530
Merge pull request #3369 from nmstoker/patch-1
Tiny fix to addHotWord doc string parameters
2020-10-12 09:03:33 +02:00
Neil Stoker
2ca91039c8
Tiny fix to addHotWord doc string parameters
As the parameter for boost was actually written as "word" in the doc string, it was replacing the previous type for word with the type intended for boost and not showing any type for boost, thus messing up what displayed on https://deepspeech.readthedocs.io/en/master/Python-API.html
2020-10-11 17:46:20 +01:00