Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

a couple of problematic results from lemmatizer #4

Open
mcthulhu opened this issue Sep 3, 2017 · 1 comment
Open

a couple of problematic results from lemmatizer #4

mcthulhu opened this issue Sep 3, 2017 · 1 comment

Comments

@mcthulhu
Copy link

mcthulhu commented Sep 3, 2017

  1. I'm not sure what's happening here, but I was trying to lemmatize the word "écœurante," with config set to {
    tagTypes: ['adj', 'ver', 'nom'],
    strictness: false,
    minimumLength: 3,
    debug: true
    };
    I had tried with strictness set to true first, then false, but it doesn't seem to matter. The result I get from

var nlpToolsFr = new NlpjsTFr(s, config);
var lemmatizedWords = nlpToolsFr.lemmatizer();

is [{"id":0,"word":"urante","lemma":"urante"}], with the écœ at the beginning removed. I can't tell why. Other words beginning with é seem OK.

  1. [{"id":0,"word":"épaules","lemma":"épaules"}] Shouldn't the lemma be "épaule"? This was with the same config object as above.
@bastienbot
Copy link
Owner

Hello mcthulhu,

  1. It kind of makes sense since I didn't anticipate this specific case, I'll patch it soon :)
  2. Weird, I'll have a look

I'll keep you informed.

Bastien

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants