Sorry if this is a dumb question, but does anyone else feel like technology - specifically consumer tech - kinda peaked over a decade ago? I’m 37, and I remember being awed between like 2011 and 2014 with phones, voice assistants, smart home devices, and what websites were capable of. Now it seems like much of this stuff either hasn’t improved all that much, or is straight up worse than it used to be. Am I crazy? Have I just been out of the market for this stuff for too long?
And if I asked you 2 years ago I bet you’d think LLMs would have gotten a lot better by now :)
They have? We went from a context windows of 2k to 1 million. The open source scene came about in that time and has basically caught up with paid alternatives. They can accept visual data and have gotten very good at reading it. Some llm have been built to function audio to audio without any text involved. The new thing this week is having it control your mouse and computer for you.
I hope you arent trying to imply that since we don’t have AGI in the space of 2 years, it means llms are failling. Falling for a venture capitalist lie doesn’t mean the sector is stagnating.
I know this was suppose to be a “gotcha” moment but it makes it clear you don’t know much about it except what the media told you to think. AI hate gets clicks.
I’m not trying to say LLM’s haven’t gotten better on a technical level, nor am I trying to say there should have been AGI by now. I’m trying to say that from a user perspective, ChatGPT, Google Gemini, etc. are about as useful as they were when they came out (i.e. not very). Context size might have changed, but what does that actually mean for a user? ChatGPT writing is still obviously identifiable and immediately discredits my view of someone when I see it. Same with AI generated images. From experience, ChatGPT, Gemini, and all the others still hallucinate points which makes it near-useless for learning new topics since you can’t be sure what is real and what’s made up.
Another thing I take issue with is open source models that are driven by VCs anyway. A model of an LLM might be open source, but is the LLM actually open source? IMO this is one of those things where the definitions haven’t caught up to actual usage. A set of numerical weights achieved by training on millions of pieces of involuntarily taken data based on retroactively modified terms of service doesn’t seem open source to me, even if the model itself is. And AI companies have openly admitted that they would never be able to make what they have if they had to ask for permission. When you say that “open source” LLMs have caught up, is that true, or are these the LLM-equivalent of uploading a compiled binary to GitHub and then calling that open source?
ChatGPT still loses OpenAI hundreds of thousands of dollars per day. The only way for a user to be profitable to them is if they own the paid tier and don’t use it. The service was always venture capital hype to begin with. The same applies to Copilot and Gemini as well, and probably to companies like Perplexity as well.
My issue with LLMs isn’t that it’s useless or immoral. It’s that it’s mostly useless and immoral, on top of causing higher emissions, making it harder to find actual results as AI-generated slop combines with SEO. They’re also normalizing collection of any and all user data for training purposes, including private data such as health tracking apps, personal emails, and direct messages. Half-baked AI features aren’t making computers better, they’re actively making computers worse.