How to build a custom sequence classification BERT model from scratch if you already have a vector?

Created
Active
Viewed 66 times
0 replies

You must be a Member of the collective to start a discussion.

-4

I have a dataset where each sequence has say 10 words, these words do not include any special tokens as of now. I have the vector representation for each of these words. I want to know how I can train a BERT model for sequence classification in this situation. I found some resources online but as of now I am worried about how the custom tokenizer should be built.