Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Small bugfix for yomdle_zh #2791

Merged
merged 29 commits into from
Oct 19, 2018
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
76dcd08
initial commit of yomdle farsi
Sep 13, 2018
0dee6e1
added README
Sep 13, 2018
dadb232
added some more comments
Sep 13, 2018
317b5b8
added option to use utf8 to prepend wordswq
Sep 13, 2018
8ecd648
changed normalized scoring to use data/test/text.old for ref files. A…
Sep 18, 2018
18970f0
adding normalization scripts to local/wer_output_filter
Sep 19, 2018
56f8dad
merged upstream and fixed conflicts with utils/lang/bpe/prepend_words…
Sep 19, 2018
d74410d
minor bug fix
Sep 19, 2018
97d23e5
initial commit for yomdle_zh
Sep 19, 2018
98cbe82
forgot to flip augment data
Sep 19, 2018
e3cb43e
fixed problems with nbsp and ideographic space
Sep 19, 2018
e2d5e84
Merge remote-tracking branch 'ChunChiehChang/yomdle2' into yomdle
Sep 20, 2018
98d538f
add changjie mapping
Sep 20, 2018
4d5d221
Merge remote-tracking branch 'ChunChiehChang/yomdle2' into yomdle
Sep 20, 2018
fe7e607
decrease number of leaves and minibatch size
Sep 21, 2018
a45b94b
added results to top of script and fixed bug in run_end2end.sh
Sep 24, 2018
b82b9a1
Merge remote-tracking branch 'ChunChiehChang/yomdle2' into yomdle
Sep 24, 2018
9d3156d
fixed minor bug
Sep 24, 2018
5dca66a
removed unused local/normalized_scoring and unused commented out code
Oct 1, 2018
e0af59e
modified README
Oct 1, 2018
65a18fe
changed file names
Oct 1, 2018
6679a9d
added examples to gedi2csv and yomdle2csv scripts. Also added code to…
Oct 1, 2018
654992b
removed unused comment
Oct 1, 2018
cc87549
minor change
Oct 1, 2018
1736397
Merge remote-tracking branch 'upstream/master' into yomdle2
Oct 15, 2018
4cebf12
fix minor changes
Oct 15, 2018
3a2a88d
merged yomdle into yomdle2
Oct 15, 2018
cacada4
don't use gpu for alignwq
Oct 15, 2018
3f9135e
adding bidi script to bpe, this is an alternative to /utils/lang/bpe/…
Oct 16, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
forgot to flip augment data
  • Loading branch information
Chun-Chieh Chang committed Sep 19, 2018
commit 98cbe82631867fba8650620a41ec6f4f045d0c81
3 changes: 2 additions & 1 deletion egs/yomdle_fa/v1/local/augment_data.sh
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
nj=4
cmd=run.pl
feat_dim=40
fliplr=false
echo "$0 $@"

. ./cmd.sh
Expand All @@ -26,7 +27,7 @@ for set in aug1; do
$srcdir $datadir/augmentations/$set
cat $srcdir/allowed_lengths.txt > $datadir/augmentations/$set/allowed_lengths.txt
local/extract_features.sh --nj $nj --cmd "$cmd" --feat-dim $feat_dim \
--fliplr false --augment true $datadir/augmentations/$set
--fliplr $fliplr --augment true $datadir/augmentations/$set
done

echo " combine original data and data from different augmentations"
Expand Down
2 changes: 1 addition & 1 deletion egs/yomdle_fa/v1/run_end2end.sh
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ fi
if [ $stage -le 2 ]; then
for datasplit in train; do
echo "$(date) stage 2: Performing augmentation, it will double training data"
local/augment_data.sh --nj $nj --cmd "$cmd" --feat-dim 40 $data_dir/${datasplit} $data_dir/${datasplit}_aug $data_dir
local/augment_data.sh --nj $nj --cmd "$cmd" --feat-dim 40 --fliplr true $data_dir/${datasplit} $data_dir/${datasplit}_aug $data_dir
steps/compute_cmvn_stats.sh $data_dir/${datasplit}_aug || exit 1;
done
fi
Expand Down