Skip to content
Advertisement

Warning: [W108] The rule-based lemmatizer did not find POS annotation for the token ‘This’

What this message is about? How do I remove this warning message?

JavaScript

Warning:

[W108] The rule-based lemmatizer did not find POS annotation for the token ‘This’. Check that your pipeline includes components that assign token.pos, typically ‘tagger’+’attribute_ruler’ or ‘morphologizer’.

[W108] The rule-based lemmatizer did not find POS annotation for the token ‘is’. Check that your pipeline includes components that assign token.pos, typically ‘tagger’+’attribute_ruler’ or ‘morphologizer’.

[W108] The rule-based lemmatizer did not find POS annotation for the token ‘some’. Check that your pipeline includes components that assign token.pos, typically ‘tagger’+’attribute_ruler’ or ‘morphologizer’.
. . . .

Advertisement

Answer

The lemmatizer is a separate component from the tagger in spacy v3. Disable the lemmatizer along with the tagger to avoid these warnings:

JavaScript
User contributions licensed under: CC BY-SA
5 People found this is helpful
Advertisement