BERT Research – Ep. 3 – Fine Tuning – p.2

In part 2, I cover the PyTorch training loop, then we’ll evaluate our fine-tuned model on the CoLA test set.

Part 1: https://www.youtube.com/watch?v=x66kkDnbzi4&list=PLam9sigHPGwOBuH4_4fr-XvDbe5uneaf6

==== Example Code ====
The Colab Notebook for this video is the same as from part 1. You can find it below.

Original: https://colab.research.google.com/drive/1Y4o3jh3ZH70tl6mCd76vz_IxX23biCPP

Updated: https://colab.research.google.com/drive/1pTuQhug6Dhl9XalKB0zUGf4FIdYFlpcX

==== Updates ====
Sign up to hear about new content across my blog and channel! https://www.chrismccormick.ai/subscribe

==== More BERT Applications ====
The BERT Research series is an 8 episode series about understanding BERT and how it works. If you are interested in BERT applications, I’ve also published the following:
– Document Classification: https://youtu.be/_eSGWNqKeeY
– ALBERT: https://youtu.be/vsGN8WqwvKg
– Question Answering: https://youtu.be/l8ZYCvgGu0o