I'm surprised the article doesn't address the Occam's Razor probability that... _most people_ hold ideas that the (a?) majority does not... and that increased media attention is likely to "discover" these beliefs.
Or rather, I see no attempt to make an argument that Nobel laureates are statistically _more_ likely than other "well-known" non-politicians to hold non-majoritarian ideas... nor any attempt to argue that the ideas followed rather than preceded the award.
I'm watching a conference talk right now from 2 weeks ago: "I Hated Every Coding Agent So I Built My Own - Mario Zechner (Pi)", and in the middle he directly references this.
He demonstrates in the code that OpenCode aggressively trims context, by compacting on every turn, and pruning all tool calls from the context that occurred more than 40,000 tokens ago. Seems like it could be a good strategy to squeeze more out of the context window - but by editing the oldest context, it breaks the prompt cache for the entire conversation. There is effectively no caching happening at all.
They are working with the same tools and knowledge like Anthropic does as Caching practices are documented. And they have as much incentive as Anthropic does to not waste compute. Can we stop acting like people who build harnesses be it Opencode oder Mario Zechners Pi are dumbfucks who don't understand caching?
can you elaborate on this? diversifying compute doesn't create more compute - is it that the different LLM vendors have different peak times and so spreading themselves over more compute vendors spreads peak load?
Yes but if there are three banana shops around and there are five banana addicted people living nearby the number of bananas available on average for every person is not 15.
In other words, if all ai companies need more compute that a single provider can provide, then there's just not enough of it. So the question "why everyone partners with everyone" must have a different answer.
It's not really "creating more compute" it's just a natural outcome of everyone desperately grabbing whatever becomes available. The dynamics make sense for all parties involved.
Firstly, it's very clear now that everyone is seriously crunched for capacity (like, each of the hyperscalers' backlogs -- i.e. capacity for which payment is committed, but as yet unsatisfied -- are in the double-digit billions.)
So as the compute providers bring more capacity online, everyone with demand wants to get a slice of that. Like, why would anyone NOT dive in and try to secure some capacity for themselves? Especially when the rate of capacity growth is constrained by the availability of GPUs and energy and data center buildouts, which is measured in years.
On the flip side, why would the compute providers NOT want multiple customers? It creates competition and drives prices up.
There are likely other forces at play too. For one, none of the parties - the model providers and the compute providers, with some of them like Google being both -- wants to get too dependent on any of the other parties, but they also want to secure a slice of each others' future growth, so they're all partnering with each other. Obviously, Google wants Gemini to win and Microsoft wants Copilot to win, but as a hedge, they'll be happy hosting their competitors' products and taking a cut.
This is partly the origin of the "circular investments" concerns. The scale at which this industry is growing, all these players have enormous mountains of money that they must invest to secure their future, but they are also the only players that can operate at this scale, and so the only place they can invest that money in is each other.
yes, what we need is for charities to operate on a quarterly reporting cycle, so that their administrative overhead increase, and (like public companies) they can be myopically focused on short-term performance.
It's truly ridiculous how detached whoever created this LLM-generated website is from the inner workings on non-profits. It's never the case that someone gives a large sum of money to do whatever the fuck you want to do with that money.
They're usually given for a fixed period of time to do something grandiose by the end of it and the NGO has to report how they've spent every cent of it, usually at the end of that grant, but sometimes along the way as well (every X months). Not to the IRS, but to grant-givers.
have you gotten a terminal interface on your phone to be acceptably usable? I haven't - not without a real keyboard attached in any case. too many parts of the UX are designed for a true keyboard.
Someone is going to solve this with a non-buggy app, but it really needs to have all the features of Claude code. Everyone is a power user in this segment
LLMs are not aligned _for_ humans in a very similar way to the way that humans themselves are not aligned _for_ humans.
We have not yet solved "alignment" for humans - I don't know why anyone thinks _we're_ going to be able to solve it for inhuman things.
reply