Lots of text classification problems deal with pairs of sentences, how can we use the Transformers library and its tokenizers to preprocess them?
This video is part of the Hugging Face course: http://huggingface.co/course
Open in colab to run the code samples:
https://colab.research.google.com/github/huggingface/notebooks/blob/master/course/videos/sentence_pairs_tf.ipynb
PyTorch version: https://youtu.be/0u3ioSwev3s
Related videos:
– The tokenization pipeline: https://youtu.be/Yffk5aydLzg
– How to batch inputs together: https://youtu.be/ROxrFOEbsQE
Have a question? Checkout the forums: https://discuss.huggingface.co/c/course/20
Subscribe to our newsletter: https://huggingface.curated.co/
Add comment