Google Deepmind RT 2 – Using LLMs to Build Thinking, Learning Robots

#deepmind #ai #robotics

🔥 Get my A.I. + Business Newsletter (free):
https://natural20.com/

[LINKS] https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action

https://robotics-transformer2.github.io/assets/rt2.pdf

https://openai.com/research/gpt-4

https://www.understandingai.org/p/large-language-models-explained-with

https://voyager.minedojo.org/assets/documents/voyager.pdf

https://twitter.com/DrJimFan


[MENTIONED VIDEOS]
Minecraft AI – SELF-IMPROVING 🤯 autonomous agent:
https://www.youtube.com/watch?v=7yI4yfYftfM

LLMs as Tool Makers [LATM] – GPT-4 *UPGRADES* lower AI Models.
https://www.youtube.com/watch?v=qWI1AJ2nSDY

Sam Altman on UBI and Massive Job Losses from AI Automation
https://www.youtube.com/watch?v=5Nsqv3FWXio

[TIMELINE]
[00:00] Intro
[02:04] Using LLMs as a “brain”
[05:28] Robotic Control
[09:03] What’s the Point?!
[12:40] The Paper
[18:15] Dr Jim Fan
[19:30] Examples and Limitations
[22:59] Training in Simulations