The biggest day in AI since GPT-4’s release. A new state of the art model, Gemini 1.5, has arrived, on the same night as a bombshell text-to-video model, Sora, from OpenAI. Gemini 1.5 can ingest up to ten million tokens (at least) and perform incredible retrieval, while also beating Ultra and GPT-4 at most benchmarks, with far less compute. I focus on Gemini 1.5 Pro, while we wait for the Sora Technical Paper. Truly, a night in the history books.
AI Insiders: https://www.patreon.com/AIExplained
Gemini 1.5 Paper: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf
Google DeepMind Blog: https://blog.google/technology/ai/google-gemini-next-generation-model-february-2024/#performance
Gemini Demos: https://www.youtube.com/watch?v=LHKL_210CcU
Needle in a Haystack:https://github.com/gkamradt/LLMTest_NeedleInAHaystack/blob/main/README.md
Mixtral of Experts: https://arxiv.org/pdf/2401.04088.pdf
Relevant Google Papers: https://openreview.net/pdf?id=qrwe7XHTmYb
https://arxiv.org/pdf/2112.06905.pdf
Tweet: https://twitter.com/recurseparadox/status/1758167314480910791
Binoculars SOTA AI text Detector:https://huggingface.co/spaces/tomg-group-umd/Binoculars
AI Insiders: https://www.patreon.com/AIExplained
Add comment