Reuben Morais
6cafcda1dd
Use progressbar2 in import_cv.py
2018-07-11 13:10:49 -03:00
Alexandre Lissy
914c923767
Augment tc download with branch
...
Fixes #1438
X-DeepSpeech: NOBUILD
2018-07-03 16:09:17 +02:00
Scott Stevenson
ccd8f560ca
Remove keyword argument that has default value
...
When no `type` keyword argument is passed to the `add_argument` method
of an `argparse.ArgumentParser`, the type will be `str` by default and
therefore this does not need to be specified.
2018-05-29 18:28:59 +01:00
Reuben Morais
3d51f0d92e
Make sure transcript field isn't coerced to float
2018-02-06 10:26:41 -02:00
farwayer
bfca43d928
taskcluster.py: create target dir if not exists
2017-12-13 14:25:17 +03:00
Tilman Kamp
1e54ab8610
Common Voice importer
2017-11-23 19:08:24 +01:00
Reuben Morais
27fe63b8ad
Merge pull request #949 from mozilla/update-root-readme
...
Update and re-organize README
2017-11-13 10:14:13 -02:00
Reuben Morais
5be0a28928
Print audio.py deprecation warning to stderr
2017-11-09 14:54:41 -02:00
Reuben Morais
9f1b20efc3
Rename util/tc.py to util/taskcluster.py
2017-11-08 14:34:05 -02:00
Reuben Morais
8ed77a0b93
Detect and warn about audio files too short for their transcripts
2017-11-01 19:58:57 -02:00
Alexandre Lissy
a4d3869bbf
Download other artifacts than native_client.tar.xz
...
Fixes #894
2017-10-18 19:03:18 +02:00
Alexandre Lissy
1082a27d4f
Document OSX
...
Fixes #893
2017-10-18 17:30:36 +02:00
Nitin Arya
bb72549297
Fix gzip format error to uncompress tar.xz via tc.py
...
Native_client file is in .tar.xz format so extracting with tar -xzvf will give error "gzip: stdin: not in gzip format"
2017-10-04 21:38:09 -07:00
Reuben Morais
9c338b76db
Fix handling of Unicode messages when using custom alphabets ( Fixes #849 )
2017-09-26 14:26:41 -03:00
Reuben Morais
4ccab71b54
Expose util/tc.py functionality as externally runnable and document it
2017-09-13 15:27:29 -03:00
Reuben Morais
2cccd33452
Remove current re-scoring of decoder output and switch to custom op
2017-09-13 11:41:15 -03:00
Alexandre Lissy
ccecc62c25
Local/Remote benchmarking tool
...
Fixes #684
2017-09-11 16:24:02 +02:00
Reuben Morais
f3ea690b38
Make sure custom alphabet code works properly on Python 2 ( #806 )
2017-09-01 11:21:01 +02:00
Reuben Morais
1c4cbf1813
Support custom alphabet mappings ( Fixes #692 ) ( #797 )
...
Support custom alphabet mappings
2017-08-31 11:51:15 +02:00
Reuben Morais
23fa1f71a5
Don't duplicate spaces in the source text when converting to integer labels
2017-08-02 17:00:30 -03:00
Sungsu Lim
403fb0bc26
fix bug in feeding.py
2017-07-13 17:34:34 -07:00
Tilman Kamp
125db9dd86
Fix #698 #699 ; cleanup and preparation step for dynamic batch size refactoring
2017-07-12 18:28:20 +02:00
Reuben Morais
d749578ef5
Improve the Python audioToInputVector implementation
2017-06-30 12:17:09 -07:00
Chris Lord
91c682eac0
Use deepspeech Python library in util/audio.py
...
Deprecate duplicated code and use libdeepspeech for consistency and speed.
2017-06-27 10:16:54 +01:00
Tilman Kamp
2968f771bb
Fix #590 ; Fix #551 ; Fix #615 ; Better process exit and exception handlin
2017-06-07 08:10:57 -07:00
Kelly Davis
843f55dbe2
Fixed #546
2017-04-20 12:46:51 +02:00
Reuben Morais
f5980781ef
Open STM files as UTF-8
2017-04-18 08:15:53 -07:00
Reuben Morais
c5c3478b8d
Clean up confusing code in DataSet by removing a redundant member variable
2017-04-14 17:26:10 -03:00
Reuben Morais
53c1f3a579
Move importer scripts to bin/
2017-04-14 17:26:09 -03:00
Reuben Morais
7d7b543c11
Re-add comment about a Python 3 requirement
2017-04-14 17:25:01 -03:00
Reuben Morais
4b2b220b2c
Make importers work as independent scripts that generate CSVs with the preprocessed dataset information
2017-04-14 17:24:59 -03:00
Reuben Morais
6c64846e75
Extract logic for loading preprocessed dataset files from the importers and decouple main script from importers
2017-04-14 17:23:27 -03:00
Reuben Morais
bdef35dbb2
Refactor DataSet class out of importers since they're all identical now
2017-04-14 17:21:48 -03:00
Reuben Morais
2da9e7849f
Process corpora in a single pass when possible, and save their definition in CSV files for performance and cleaner code.
2017-04-14 17:21:48 -03:00
mike mcginty
7ff223a132
fix _example_queue to be example_queue as named in the importers
2017-04-02 02:14:09 -04:00
Tilman Kamp
8d21d0cbd2
Fix #328 ; distributed TensorFlow
2017-03-31 17:10:34 +02:00
Reuben Morais
cd9d0f3172
Make sure the argument to text_to_char_array is a string on Python 3
2017-03-29 11:15:31 +02:00
Mike C. Fletcher
2e87ab6c13
Implement Reuben's changes from pull request #465
2017-03-28 13:37:38 -04:00
Mike C. Fletcher
efd3b88061
Tell the user where the data has to be for librivox *and* warn them how big the download will be
2017-03-28 13:24:37 -04:00
Mike C. Fletcher
dc1b05f9ee
Fix some indentation so that pylint etc. will shut up about the files
2017-03-28 12:09:01 -04:00
Mike C. Fletcher
e2572913b8
Another bit of python3 compatibility, this time for librivox importer
2017-03-28 12:08:34 -04:00
Mike C. Fletcher
bae4989660
Further fixes to get the initial test run to finish
2017-03-27 00:53:23 -04:00
Mike C. Fletcher
b0f9893a7d
Use relative imports for sibling modules
2017-03-26 15:02:47 -04:00
Mike C. Fletcher
288bd64a53
Conversions to modern print statements
2017-03-26 14:58:51 -04:00
Graham Voysey
5bf7787136
properly formatting display status bars
2017-03-21 13:37:50 -04:00
Graham Voysey
e5b88cd093
refactored librivox.py for PEP8 compliance and use of informative progress bars to display actions taken during initial creation of the data set to the user.
2017-03-21 13:34:34 -04:00
Kelly Davis
4765953b99
Fixed #412
2017-03-07 15:05:49 +01:00
Kelly Davis
8f93127298
Fixed #403
2017-02-24 10:36:23 +01:00
Alexandre Lissy
3838c0a9ce
Upgrade to run on Tensorflow 1.0.0
2017-02-22 14:48:47 +01:00
Kelly Davis
e00655321e
Addressed review comments
2017-02-22 14:39:07 +01:00
