Phi-2 is a tiny model that could fit on a phone, but it outperforms huge language models like Llama 2. I explain more about how it was made and what it means. Then we see Imagen-2, the most stunning text-to-image yet, at least according to Google’ images. We then glimpse Optimus 2, smaller in the sense that it’s 10kg lighter! With more degrees of freedom, it’s movements look a lot more humanoid. And then the full launch of AI Insiders, plus a recap of why we shouldn’t use the MMLU to 2 decimal places!
https://www.patreon.com/AIExplained
phi2 now on HuggingFace: https://huggingface.co/microsoft/phi-2
Bubeck Video, min 19: https://www.youtube.com/watch?v=24O1KcIO3FM
Phi 2: https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/
Shital Shah: https://twitter.com/sytelus/status/1734882570603753814
Shoggoth: https://twitter.com/norabelrose/status/1702488701782352097
Mamba 3B: https://www.together.ai/blog/mamba-3b-slimpj
Phi 1.5B: https://arxiv.org/abs/2309.05463
Phi 1: https://arxiv.org/abs/2306.11644
Microsoft Prompting: https://www.microsoft.com/en-us/research/blog/steering-at-the-frontier-extending-the-power-of-prompting/
SmartGPT Video: https://www.youtube.com/watch?v=hVade_8H8mE&t=554s
The Information: https://www.theinformation.com/articles/how-microsoft-is-trying-to-lessen-its-addiction-to-openai-as-ai-costs-soar?rc=sy0ihq
Imagen 2: https://twitter.com/googledeepmind/status/1734954295655534780
https://deepmind.google/technologies/imagen-2/?utm_source=twitter&utm_medium=social
https://twitter.com/elonmusk/status/1734763060244386074
Greg Technology: https://twitter.com/TheRundownAI/status/1734544659953623509
Swyx: https://www.latent.space/
AI Engineer: https://youtube.com/@aiDotEngineer?si=HhMdIwClGS3re9UK
Shawn Wang: https://x.com/swyx?s=09
https://www.patreon.com/AIExplained
Add comment