![](/static/253f0d9b/assets/icons/icon-96x96.png)
![](https://lemmygrad.ml/pictrs/image/f17ad521-c66e-45b4-976b-eed9c8fbf5ed.png)
Well, yeah, but perhaps that implies they don’t know who the actual communists are, so they will still target the “commie” demonrats
Well, yeah, but perhaps that implies they don’t know who the actual communists are, so they will still target the “commie” demonrats
AI/ML research has long been notorious for choosing bullshit benchmarks that make your approach look good, and then nobody ever uses it because it’s not actually that good in practice.
It’s totally possible that there will be legitimate NLP use-cases where this approach makes sense, but that is almost entirely separate from the current LLM craze. Also, transformer-based LLMs pretty much entirely supplanted recurrent networks as early as like 2018 in basically every NLP task. So even if the semiconductor industry massively reoriented to producing chips that support “MatMul-free” models like this one to even get an energy reduction, that would still mean that the model outputs would be even more garbage than they already are.
I’m highly skeptical of this at first glance. Replacing self-attention with gated recurrent units seems like a decisive step back in natural language processing capabilities. The advancement that gave rise to LLMs in the first place was when people realized that building networks out of a bunch of self-attention blocks instead of recurrent units like GRU or LSTM was extremely effective.
In short, they are proposing an older type of model which are generally outclassed by attention-based transformers that power all the LLMs we see today. I doubt it will be able to achieve nearly as good results as existing LLMs. I foresee this type of research being used to silence criticisms of the ungodly amounts of energy used by LLMs to say “See, people are working on making them way more efficient! Any day now…” Meanwhile they will never come to fruition.
Yes, once you become a member you are expected to contribute to the annual fund drive.
The strike was aimed at a target in occupied Palestine, seems appropriate.
Isn’t the FLG headquarters compound in like upstate NY or something
I personally reject the notion that a just and equitable future can only be built on a pile of corpses.
Ok, then how?
Hey dumbass, headlines follow different style practices. The same conventions of grammar do not apply.
This is some absolutely depraved shit. You’re sitting here justifying levels of death and destruction and human misery that are beyond your comprehension just because of some made up conspiracy theories about Russia “meddling” with other countries. In what possible universe does that make you anything other than pure fucking evil?
so, what, you just make shit up then deflect when someone points that out?
Actually, they replaced it a few years ago with something that’s totally not a sonnenrad.
Ok, and? That doesn’t contradict my point. Mainstream medicine in America works a lot of the time, but is fundamentally corrupted by the society it exists in. There are a ton of cases where it doesn’t help anyone or actively makes people’s health worse, so even completely ineffective alternative treatments are better by comparison in those instances. Then you have alternative treatments like cannabis, MDMA, or psilocybin which are prohibited from mainstream medicine, but almost certainly work better for some patients than what can be offered by mainstream medicine. Granted, it seems likely that they will someday be considered mainstream medicine, but that is not currently the case.
I should add that if your definition of “mainstream medicine” is simply “everything that works”, then you just have a useless definition. It does not capture the real treatment a patient may receive when they see a doctor in America.
Dumb take. Mainstream medicine is still warped by the conditions of the society in which it is developed and practiced. In America, that means politicized/racist drug policy results in prohibition of actually useful drugs while creating a massive legally prescribed opiod addiction epidemic. That doesn’t mean it’s all bad, but there’s certainly a lot of ways in which “alternative” medicine works better than mainstream medicine.
Yeah, well, they get into the economics departments at these top schools, so…
They’re hindering Americans’ return to Earth, too, actually