I forget where I first saw this analogy, but describing LLMs as a broken clock just makes so much sense. You cannot scale up or improve LLMs to address fundamental limitations with the technology any more than you can make a hyperscale broken-clock data center to more accurately tell time.
It's part of what makes OpenAI's pandering to Trump so completely pathetic. Building more data centers won't get you *any* of what OpenAI is promising. It just isn't how anything works.
https://pivot-to-ai.com/2025/03/14/openai-asks-the-us-government-for-the-moon-on-a-stick/
(The other comparison I'd make is to a Vegas slot machine. They make a *lot* of noise when you win, not so much when you lose. It's easy to come away with the impression that folks around you are winning a lot more than they are. AI companies love hyping up when their shit happens to slop out a useful answer, but whenever they do what LLMs do, well, you just suck at prompt engineering or something.)
If I just stole your analogy, my apologies for forgetting...! Please let me know and I'll go edit the above post to credit you.
@xgranade Factoring in the fancy dings when you "win" less money than you bet on the spin, this is a very good analogy.
@xgranade their ceo is serving me mutated Neanderthal realness
@xgranade But what if we put up 86400 broken clocks up in a 'clockycenter' and set them to a different second, ensuring that at least 1 clock is correct for every second in a day?
I value this company at 100 billion dollars.
@cthos I see no problems, here's $10B in seed money.
@cthos@mastodon.cthos.dev @xgranade@wandering.shop “where’s all my money”, you ask of me? I have already given it to you for this revolutionary clock system before you could even ask! Get me the clockosphere right now! I want to ask it when dinner is.”
@xgranade@wandering.shop “we have created a system with 43,200 precisely broken clocks which are stochastically rotated around to show you a clock when you want to check the time. The degree of rotation (and subsequent clock you are shown) is based on how tired you sound when you ask what time it is. This is much more efficient than a non broken clock and has nothing to do with my clock making business (that is made even cheaper since I don’t have to make working ones, just ones with a face).”
@cthos@mastodon.cthos.dev @xgranade@wandering.shop “my clockosphere comes in at HALF the cost of cthos’ system!”
@cthos@mastodon.cthos.dev @xgranade@wandering.shop “I am still asking for 10 billion dollars because I am a very special birthday boy.”
@aud @xgranade You simply cannot rely on Asta's Clockosphere, what happens if the clocks break *more*? This is why you must pay me extra money. Also I'm introducing "motionclock" which rotates individual dials instead of the whole clock! Each motion is controlled by a man named Jeff. That's right, we have 86400 Jeffs.
@cthos@mastodon.cthos.dev @xgranade@wandering.shop enter the jeffiverse
@aud Gah, and to think I once cared about standard quantum versus Heisenberg scaling for clock accuracy when I could have just... made shit up.