The block user button is your friend
- 0 Posts
- 9 Comments
TheMightyCat@ani.socialto
Selfhosted@lemmy.world•Replaced $40/month in AI API subscriptions with self-hosted Ollama + n8nEnglish
5·17 days agoI’m running 2x4090, the 35B fits very comfortable in that.
For large models like the 397B without a ton of money there are several ways, ive seen posts of people using arrays of used 3090s with good results.
The other option is CPU inference although with current RAM prices that is less cost effective.
I was looking at maybe an array of Milk-V JUPITER2 since vllm added riscv support which could be very cost effective.
TheMightyCat@ani.socialto
Selfhosted@lemmy.world•Replaced $40/month in AI API subscriptions with self-hosted Ollama + n8nEnglish
12·17 days agoDepending what OP was using before but going from something like GPT5.2 to LLama 3 8B will be a massive difference (Although OP says to use it only for basic tasks so that does offset it)
LLama 3 already being a very old model doesn’t help either
I run Qwen3.5-35B-A3B-AWQ-4bit which while leagues ahead of LLama 3 8B still is a very noticeable difference.
This is not to say open source is bad, if one had the resources to run something like Qwen3.5-397B-A17B it would also be up there.
TheMightyCat@ani.socialto
News@lemmy.world•Vital U.S. radar aircraft was destroyed by Iranian strike on U.S. base in Saudi Arabia, photos show
18·30 days agoLosing a vital plane now when you are at war then it doesn’t really matter if it might get replaced sometime far in the future
TheMightyCat@ani.socialto
News@lemmy.world•US F-35 damaged by suspected Iranian fire makes emergency landing, sources say
3·1 month agoYou don’t have to be a tankie or a wankie to recognize the fact that a loss ratio of 0% is very good for an aircraft.
If it was a Russian or Chinese aircraft doing this then that would also be a fact.
It’s stupid to say that a single aircraft being damaged makes the entire type worthless like many here are saying when the F-35 is the only aircraft flying these missions and come back with only damage to a single plane.
That is not a political statement or approval of the strikes. That’s just a statement on the plane.
TheMightyCat@ani.socialto
News@lemmy.world•US F-35 damaged by suspected Iranian fire makes emergency landing, sources say
91·1 month agoFor the all the probably hundreds of sorties flown with a result of zero losses and only a single aircraft being damaged they might aswell be invisible.
any tips?
My laptop has this option in the bios settings
Not sure if it’s only for laptops but you could check there.
I’m running wayland with nvidia-open and nvidia-utils packages, and have never encountered any driver issues in both graphics and compute.


Everyone’s linux is in bed witu US corpos if you just look at the commit history of the kernel