Overzealous lemmatisation of -ss nouns

[adam-ra]

The final -s is stripped even though the tag assigned is a singular noun (NN).
Some examples: sleepiness, incompleteness, loss, ass (unless they are recognised as proper nouns, which happens often if they are sentence-first).

A similar thing happens to nouns with other suffixes, e.g. anus → anu.

Seen in Spacy 1.7.2, model en_depent_web_md-1.2.1.

[honnibal]

Damn. I know exactly what must have caused this :(

There's a base-form check in the lemmatizer --- if a word is listed as a base form, it shouldn't be lemmatized. Obviously this check is broken for nouns.

[honnibal]

Here: https:/explosion/spaCy/blob/master/spacy/lemmatizer.py#L52

This looks up the enum symbols for the verb-forms, but misses the enum symbols for the nouns. We just need to list the morphological features that indicate the noun is a base form, and list them here.

We also need a regression test. I've got meetings today and most of tomorrow, so I'm hoping someone else can get the fix up? 🙇‍♂️ It will need a regression test too.

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.