Pinned Bulletins
View all 1 bulletinsNLP has some news to share
Can you answer these questions?
View all unanswered questionsThese questions still don't have an answer
How to run Pytorch, huggingface pretrained DeBerta in jupyter notebook? Setup: Win11, RTX3070
Sqrt(5) is 2.24, so 16.46063 should become 7.35, not 3.3, is it a mistake?
Not able to create a config.json when saving my finetuned Llama 2
grid search on parrot paraphraser
Failed to import transformers.training_args because of the following error - failed to map segment from shared object - Lambda and Docker
Looking for an extra challenge?
View all bountied questionsThese questions have a bounty on them
How does one use accelerate with the hugging face (HF) trainer?
Recommended answers
View all recommended answersThese answers have been recommended
BERT token vs. embedding
Inside BERT, as well as most other NLP deep learning models, the conversion from token IDs to vectors is done with an Embedding layer. For instance, in Pytorch it is the torch.nn.Embedding module. The ...
Error while loading a tagger (probably missing model file)
Almost certainly this means that the tagger model file is not present at runtime on the path specified. At runtime, does the path you give: libs/stanford-corenlp-4.5.4-models.jar work to access the ...
How to de-normalize text in Python?
I understand that you mean to generate all possible inflexions of an English word. For that, you may use LemmInflect as follows: from lemminflect import getAllInflections > getInflection('watch', ...
How to concatenate a split word using NLP caused by tokenizers after machine translation?
Try detokenizers but because there are rules to process tokens that are expected to change x 's -> x's but not x ' s -> x's, you might have to iteratively apply the detokenizer, e.g. using ...
Can i use 4 bit, 8 bit version of transformers translation model?
It might not work for every model, but you can try 8-bit quantization with native pytorch, https://pytorch.org/tutorials/recipes/recipes/dynamic_quantization.html like this: import gc import torch ...
See what's trending
View all trending questionsThese are the most active questions in NLP Collective
How does the Google "Did you mean?" Algorithm work? [closed]
What is "entropy and information gain"?
How to compute the similarity between two text documents?
spacy Can't find model 'en_core_web_sm' on windows 10 and Python 3.5.3 :: Anaconda custom (64-bit)
Failed loading english.pickle with nltk.data.load
Simply submit a proposal, get it approved, and publish it.
See how the process works