Tags: pgari/pytext
Tags
Missing 'f' from f-string (facebookresearch#1229) Summary: Pull Request resolved: facebookresearch#1229 F-string was missing `f`. Reviewed By: arbabu123 Differential Revision: D19377335 fbshipit-source-id: b779ae73ae370ca9e3be2eafd87a70c3e20b798f
Start, End index calculations fix for unicode characters. (facebookre… …search#1171) Summary: Pull Request resolved: facebookresearch#1171 The existing GPT2BPETokenizer incorrectly calculates the start and end indices for unicode characters. This is because for multi-byte characters, we need to additionally use the byte decoder on the decoded bytes to get back the original token that was encoded. Reviewed By: chenyangyu1988 Differential Revision: D18697646 fbshipit-source-id: 8f4d32a1caa40d8d06e7be31dfd4a6846692531a
EASY [PyText] fix OSS release (facebookresearch#909) Summary: Pull Request resolved: facebookresearch#909 this is a reconciliation diff to match what was just released to as v0.2.2. There was several issues during this release, and I uploaded to pypi a package that was broken. Pypi does not allow overwriting, so I had to increase the version number. I manually fixed the source (because it was minor packaging and dependency problems) and pushed package 0.2.2. This diff includes those fixes after the fact to make the sources consistent with the release. Changes are: - fix fairseq requirement (separate diff, landing now) - add __init__.py to make qna a module included in the release - amend CHANGELOG to match version numbers Reviewed By: neo315 Differential Revision: D16809591 fbshipit-source-id: 89a8c9804617e73ecbff484e893ce79ad0049094
release 0.2.0 (facebookresearch#696) Summary: Pull Request resolved: facebookresearch#696 release 0.2.0 & changelog Reviewed By: bethebunny, chenyangyu1988 Differential Revision: D15835455 fbshipit-source-id: e7faa690c280468207c1b05080286dc93ad60d08
export command broken by missing metric_reporters (facebookresearch#271) Summary: Pull Request resolved: facebookresearch#271 Removed an if by mistake in D13829608 Reviewed By: bethebunny Differential Revision: D13978522 fbshipit-source-id: 1adbdade1f5ca1241c15c9c3300e4a7163370be7
Document top-level API a little, make testing from the command line e… …asier. (facebookresearch#106) Summary: Pull Request resolved: facebookresearch#106 Add docstrings and types to a couple functions exported to the top-level PyText API. Update the test cli mode to take in a PyTextConfig rather than a TestConfig for easier command line usage. Reviewed By: ahhegazy Differential Revision: D13367488 fbshipit-source-id: 2347e63f4e31a737566ef6aabd3399a79e6ff023