Tag: wordnet

Neither stemmer nor lemmatizer seem to work very well, what should I do?

countvectorizer lemmatization python stemming wordnet

I am new to text analysis and am trying to create a bag of words model(using sklearn’s CountVectorizer method). I have a data frame with a column of text with words like ‘acid’, ‘acidic’, ‘acidity’, ‘wood’, ‘woodsy’, ‘woody’. I think that ‘acid’ and ‘wood’ should be the only words included in the final output, however neither stemming nor lemmatizing seems

Meaningless Spacy Nouns

python spacy text wordnet

I am using Spacy for extracting nouns from sentences. These sentences are grammatically poor and may contain some spelling mistakes as well. Here is the code that I am using: Code Output: Similarly for sentence “fast foward2”, I get Spacy noun as Which shows that these nouns have some meaningless words like: sfx, foward2, ms, 64x, bit, pwm, r, brailledisplayfastmovement,

Using NLTK and WordNet; how do I convert simple tense verb into its present, past or past participle form?

nlp nltk python wordnet

Using NLTK and WordNet, how do I convert simple tense verb into its present, past or past participle form? For example: I want to write a function which would give me verb in expected form as follows. Answer I think what you’re looking for is the NodeBox::Linguistics library. It does exactly that: