Embeddings: The Unsung Hero of the ChatGPT Revolution (That Will Probably Save Google)
AI dominates every digital space. More specifically OpenAI with ChatGPT and GPT4, clearly outperforming [at least in public perception] usual suspects like Google who claimed to be “AI first”, since 2016. The irony is that OpenAI uses Transformers for its star product ChatGPT and friends, which is a Google invention from 2017. There are many reports that Google sounded the alarm to catch up, and yesterdays Google IO shows they are all-in. But a comparison between OpenAI and Google strategies, in my opinion, reveals starkly contrasting strategies: OpenAI goes loudly and boldly all in on generative text, and Google (more silently) on embeddings. ...