Skip to main content
Collection

Natural Language Processing FAQ

Frequently asked questions relating to NLP. Many of these may be questions that are often asked over and over, duplicates would likely be closed in favor of these. Add the best answer (using the answer URL) if the question itself is brief.

Created
Active
Last edited
Viewed 1k times
Part of NLP Collective
6
354 votes
7 answers
219k views

What is "entropy and information gain"?

Answer Accepted

I assume entropy was mentioned in the context of building decision trees. To illustrate, imagine the task of learning to classify first-names into male/female groups. That is given a list of names ...

View answer
Amro's user avatar
Thorough answer to this question
Berthold's user avatar
284 votes
14 answers
308k views

How to compute the similarity between two text documents?

Answer Accepted

The common way of doing this is to transform the documents into TF-IDF vectors and then compute the cosine similarity between them. Any textbook on information retrieval (IR) covers this. See esp. ...

View answer
Fred Foo's user avatar
Common approach to this
Berthold's user avatar
100 votes
10 answers
104k views

How to use Bert for long text classification?

Common question
Berthold's user avatar
Deleted
0 votes
4 answers
393 views

What is the benefit of NLP sentence segmentation over Python algorithm? [closed]

Commonly asked question
Futurist Forever's user avatar
1 vote
2 answers
767 views

Information extracting from plain text using NLP

Basic action to perform Named Entity Recognition, one of the fundamental NLP tasks
SilentCloud's user avatar

Add questions, answers or articles to this collection

Become a contributor and help curate this collection.

You must join and become a Member of the collective to add posts to a collection.

Search for content by title or URL and click on a result to add to the collection.