There is a brand new AI Chatbot platform called Groq that can answer any prompt in near real-time speed.
In my testing, it was 3-4 times faster than ChatGPT.
Two important notes before I show you how it works in more detail.
Groq with a Q is not the same as Grok on Twitter.
When I looked into it, it turns out the Groq has been around for much longer and they even have the trademark on the word. And they released a letter asking Elon Musk to change the name of his AI chatbot, Grok.
Groq is also not a large language model like Grok and ChatGPT. It’s a language processing unit. So its purpose is to run AI models like large language models using that technology and give you speed that other models haven’t achieved.
They way Groq explains it’s speed is due to it’s hardware. They use LPU which is a new technology they created, specifically for this reason.
All other LLMs are using GPUs.
Add comment