If you’re using spaCy and have been waiting to incorporate pretrained models in your applications, then look no further than spacy-pytorch-transformers.
It allows you to use models like BERT in spaCy by interfacing with Hugging Face’s PyTorch implementations.
The library also aligns the transformer features with spaCy’s linguistic tokenization, so you can apply the features to the actual words, instead of just wordpieces.
Comments