How to check if a neural network has learned a specific phenomenon?

🤔 In this video, Ms. Coffee Bean and I explain how “probing” neural networks (in NLP) works. In other words, how we check if a neural net trained on task A is also able to perform task B.

We are also touching upon a very nice paper, recently published by Elena Voita and Ivan Titov. Since I strongly recommend anyone to read it, here is the reference to the explained paper:
Information-Theoretic Probing with Minimum Description Length on https://arxiv.org/pdf/2003.12298.pdf

▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
Patreon: https://www.patreon.com/AICoffeeBreak
Ko-fi: https://ko-fi.com/aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀

🔗 Links:
YouTube: https://www.youtube.com/channel/UCobqgqE4i5Kf7wrxRxhToQA/
Twitter: https://twitter.com/AICoffeeBreak
Reddit: https://www.reddit.com/r/AICoffeeBreak/

#AICoffeeBreak #MsCoffeeBean