In this video, we will see how to preprocess a dataset for a causal language modeling task.
This video is part of the Hugging Face course: http://huggingface.co/course
Open in colab to run the code samples:
https://colab.research.google.com/github/huggingface/notebooks/blob/master/course/videos/clm_processing.ipynb
Related videos:
– Fine-Tuning with TensorFlow: https://youtu.be/AUozVp78dhk
– The Trainer API: https://youtu.be/nvBXf7s7vTI
– Write your training loop in PyTorch: https://youtu.be/Dh9CL8fyG80
– Supercharge your PyTorch training loop with Accelerate: https://youtu.be/s7dy8QRgjJ0
Don’t have a Hugging Face account? Join now: http://huggingface.co/join
Have a question? Checkout the forums: https://discuss.huggingface.co/c/course/20
Subscribe to our newsletter: https://huggingface.curated.co/
Add comment