For the last five years, the AI industry has been obsessed with a single, rather brute-force strategy: Scaling. Basically, the bigger the better. We were sold a narrative that if we just fed more data and more chips into the “Transformer” architecture (the engine behind ChatGPT), it would eventually be categorized as the coveted “AGI”.Continue reading “The “Big AI” Era is Over.”