The hunt is on for new architectures following years of domination by the transformer type of AI. Transformers are the fundamental building blocks of text-generating models such as Google’s Gemini, Anthropic’s Claude, and OpenAI’s GPT-4o. They also support the company’s video-generating model Sora. However, they are now encountering technical obstacles, namely those pertaining to computation.
↧