Lots of text classification problems deal with pairs of sentences, how can we use the Transformers library and its tokenizers to preprocess them?
This video is part of the Hugging Face course: http://huggingface.co/course
Open in colab to run the code samples:
https://colab.research.google.com/github/huggingface/notebooks/blob/master/course/videos/sentence_pairs_pt.ipynb
TensorFlow version: https://youtu.be/P-rZWqcB6CE
Related videos:
– The tokenization pipeline: https://youtu.be/Yffk5aydLzg
– How to batch inputs together: https://youtu.be/M6adb1j2jPI
Have a question? Checkout the forums: https://discuss.huggingface.co/c/course/20
Subscribe to our newsletter: https://huggingface.curated.co/
Add comment